BTSync - Bittorrent Sync file replication Mega Thread

Discussion in 'Hosting Talk & Reviews' started by drmike, Sep 24, 2014.

  1. drmike

    drmike 100% Tier-1 Gogent

    8,573
    2,717
    May 13, 2013
    Appears that a bunch of us are experimenting with file replication solutions lately or maybe have such running for a bit.

    This is for BTSync / Bittorrent Sync.

    Some questions:

    1. Anyone successfully running BTSync on a LAN/WAN on all internal IP arrangement?   Does it work with such or does it need to speak to the public internet all the time?

    2.  Who has a successful and straightforward install process for BTSync on Debian / related systems?
     
  2. rmlhhd

    rmlhhd New Member Verified Provider

    168
    31
    May 22, 2015
    Works great on Debian and Ubuntu
     
  3. mikeyur

    mikeyur New Member Verified Provider

    73
    33
    May 23, 2014
    drmike likes this.
  4. splitice

    splitice Just a little bit crazy... Verified Provider

    550
    252
    Jun 16, 2013
    Install is simple. Server deployment in our case is done via shell script. Currently not using a repository.

    To install:

    1. Optional: Create user for btync to run as (or group and add your own user to it etc)
    2. Copy btsync to directory
    3. chmod +x btsync
    4. copy confifguration file in
    5. Add init.d script
    6. update-rc.d [init script] defaults
    7. Optional: Change client name in configuration file (can be automated with sed)
    8. Run
    Nothing too complex is required. Its basically a single binary service with a configuration file.

    Note you have to run the same version on all servers. Be sure to disable the update prompts on windows as they will get annoying.
     
    Last edited by a moderator: Sep 24, 2014
    drmike likes this.
  5. drmike

    drmike 100% Tier-1 Gogent

    8,573
    2,717
    May 13, 2013
    Alright, now we are cooking with fuel....   repository about to be added and some testing in a bit :)  THANK YOU!
     
  6. HalfEatenPie

    HalfEatenPie The Irrational One Retired Staff

    2,890
    1,386
    Mar 25, 2013
    HalfEatenPie
    Just for clarification purposes.

    Btsync is basically a Dropbox alternative that uses the bittorrent protocol right?

    How is it for large files?  And for files that are constantly being changed from many locations?  
     
    sv01 likes this.
  7. splitice

    splitice Just a little bit crazy... Verified Provider

    550
    252
    Jun 16, 2013
    Large files - no problem. Its bittorent so its chunked.

    Constantly changing is problematic, seems to use timestamps to resolve conflicts. If time is out of sync at any node seems to cause major issues.
     
    HalfEatenPie and drmike like this.
  8. sv01

    sv01 Slow but sure

    426
    87
    May 17, 2013
    for large files no problem, but for files that are constantly change, btsync will complain (I test on file log, that change every few second)

    btw now I'm moving to Syncthing
     
    Last edited by a moderator: Sep 24, 2014
    HalfEatenPie likes this.
  9. drmike

    drmike 100% Tier-1 Gogent

    8,573
    2,717
    May 13, 2013
    Well Syncthing *looks* nice, but they are shipping updates darn near daily.

    Android version installed and nothing configged and it's taking a chunk of battery. Meh.  Android the OS that will bring back the backphone battery ;)

    @sv01

    "but for files that are constantly change, btsync will complain (I test on file log, that change every few second)"

    So, what does BTSync do with these?  What breaks and if the updates were less frequent, do you think btsync would catch up?
     
  10. sv01

    sv01 Slow but sure

    426
    87
    May 17, 2013
    I never use Synthing android app before and that port unofficially. 

    If your file changes not as fast as file log nothing wrong there, both BTSync and Syncting can't sync these file correctly. I test against file log because I want to know how they handle file that changes really fast :) but both of them failed.

    For my multimedia, backup and configuration files both working just fine. Nothing to complain.
     
  11. drmike

    drmike 100% Tier-1 Gogent

    8,573
    2,717
    May 13, 2013
    Well I just got daring and spun up a new remote VPS to fuss with Syncthing.... It's damn nifty once you figure out the plumbing.  It's a bit slow getting started and figuring out what to config and where.

    Web interface on it too [built in]  pops open on localhost which is dumb on remote servers and lacks any username/password by default and one must manually go find such and be diligent.   Both items need addressed by development.

    A proper repository version would be nice too [for Debian of course]....

    Their peer discovery is nice, albeit it slow.  Placing in this case the remote IP for the VPS in the config is much faster on initiating communications and getting files moving.

    I am going to commit a portion of the next week to getting comfortable with Syncthing.
     
    k0nsl likes this.
  12. AThomasHowe

    AThomasHowe New Member

    190
    49
    Jun 3, 2014
    BTSync is good for small amounts of files. I tried experimenting with it for no-headaches backups but it got pretty resource heavy scanning through 20 or 30k small files. I use pretty low end boxes though.

    I'm just back to using rsync. 
     
    drmike likes this.
  13. splitice

    splitice Just a little bit crazy... Verified Provider

    550
    252
    Jun 16, 2013
    Unfortunately I concur, we ended up syncing archives. Wasn't a big issue in the end since those archives became our packages and in the end it was cleaner for it.

    Plus permissions can be preserved :)
     
  14. mojeda

    mojeda New Member

    347
    183
    May 14, 2013
    I used btsync with over 6GBs of media files, audio, video, PDF, etc and it worked pretty good.

    One of the things I like was that servers would sync from each other and not just one server.
     
    drmike likes this.
  15. drmike

    drmike 100% Tier-1 Gogent

    8,573
    2,717
    May 13, 2013
    Does BTSync offer remote file view/preview without downloading the whole data set?

    "... but it got pretty resource heavy scanning through 20 or 30k small files."

    That's not a ton of files.  Those were spread out and not a single directory worth, right?
     
  16. JahAGR

    JahAGR New Member

    36
    9
    Oct 19, 2013
    This is pretty much my experience. I threw about 2TB of files at it (idk how many individual files offhand) and it was slow to churn through all of them but the transfer speeds were good. I also went back to rsync :p
     
    drmike likes this.
  17. johnlth93

    johnlth93 New Member

    182
    14
    May 26, 2013
    LAN network works just fine, tried it between my laptop and my phone
     
  18. stim

    stim New Member

    115
    32
    Jun 22, 2013
    I've been using BTsync with success for over a year, syncing data across 3 servers and my LAN. It has worked like a champ. 
     
    drmike likes this.
  19. drmike

    drmike 100% Tier-1 Gogent

    8,573
    2,717
    May 13, 2013
    Good endorsement!

    Rough estimate on total chunk of disk shared?
     
  20. incloudibly

    incloudibly New Member Verified Provider

    16
    0
    Oct 13, 2014
    Yes, except for you are free to choose where to store your files at and no third party has access to this data.