amuck-landowner

BTSync - Bittorrent Sync file replication Mega Thread

drmike

100% Tier-1 Gogent
Appears that a bunch of us are experimenting with file replication solutions lately or maybe have such running for a bit.

This is for BTSync / Bittorrent Sync.

Some questions:

1. Anyone successfully running BTSync on a LAN/WAN on all internal IP arrangement?   Does it work with such or does it need to speak to the public internet all the time?

2.  Who has a successful and straightforward install process for BTSync on Debian / related systems?
 

splitice

Just a little bit crazy...
Verified Provider
Install is simple. Server deployment in our case is done via shell script. Currently not using a repository.

To install:

  1. Optional: Create user for btync to run as (or group and add your own user to it etc)
  2. Copy btsync to directory
  3. chmod +x btsync
  4. copy confifguration file in
  5. Add init.d script
  6. update-rc.d [init script] defaults
  7. Optional: Change client name in configuration file (can be automated with sed)
  8. Run
Nothing too complex is required. Its basically a single binary service with a configuration file.

Note you have to run the same version on all servers. Be sure to disable the update prompts on windows as they will get annoying.
 
Last edited by a moderator:

HalfEatenPie

The Irrational One
Retired Staff
Just for clarification purposes.

Btsync is basically a Dropbox alternative that uses the bittorrent protocol right?

How is it for large files?  And for files that are constantly being changed from many locations?  
 

splitice

Just a little bit crazy...
Verified Provider
Large files - no problem. Its bittorent so its chunked.

Constantly changing is problematic, seems to use timestamps to resolve conflicts. If time is out of sync at any node seems to cause major issues.
 

sv01

Slow but sure
for large files no problem, but for files that are constantly change, btsync will complain (I test on file log, that change every few second)

btw now I'm moving to Syncthing
 
Last edited by a moderator:

drmike

100% Tier-1 Gogent
Well Syncthing *looks* nice, but they are shipping updates darn near daily.

Android version installed and nothing configged and it's taking a chunk of battery. Meh.  Android the OS that will bring back the backphone battery ;)

@sv01

"but for files that are constantly change, btsync will complain (I test on file log, that change every few second)"

So, what does BTSync do with these?  What breaks and if the updates were less frequent, do you think btsync would catch up?
 

sv01

Slow but sure
Well Syncthing *looks* nice, but they are shipping updates darn near daily.

Android version installed and nothing configged and it's taking a chunk of battery. Meh.  Android the OS that will bring back the backphone battery ;)

@sv01

"but for files that are constantly change, btsync will complain (I test on file log, that change every few second)"

So, what does BTSync do with these?  What breaks and if the updates were less frequent, do you think btsync would catch up?
I never use Synthing android app before and that port unofficially. 

If your file changes not as fast as file log nothing wrong there, both BTSync and Syncting can't sync these file correctly. I test against file log because I want to know how they handle file that changes really fast :) but both of them failed.

For my multimedia, backup and configuration files both working just fine. Nothing to complain.
 

drmike

100% Tier-1 Gogent
Well I just got daring and spun up a new remote VPS to fuss with Syncthing.... It's damn nifty once you figure out the plumbing.  It's a bit slow getting started and figuring out what to config and where.

Web interface on it too [built in]  pops open on localhost which is dumb on remote servers and lacks any username/password by default and one must manually go find such and be diligent.   Both items need addressed by development.

A proper repository version would be nice too [for Debian of course]....

Their peer discovery is nice, albeit it slow.  Placing in this case the remote IP for the VPS in the config is much faster on initiating communications and getting files moving.

I am going to commit a portion of the next week to getting comfortable with Syncthing.
 

AThomasHowe

New Member
BTSync is good for small amounts of files. I tried experimenting with it for no-headaches backups but it got pretty resource heavy scanning through 20 or 30k small files. I use pretty low end boxes though.

I'm just back to using rsync. 
 

splitice

Just a little bit crazy...
Verified Provider
Unfortunately I concur, we ended up syncing archives. Wasn't a big issue in the end since those archives became our packages and in the end it was cleaner for it.

Plus permissions can be preserved :)
 

mojeda

New Member
I used btsync with over 6GBs of media files, audio, video, PDF, etc and it worked pretty good.

One of the things I like was that servers would sync from each other and not just one server.
 

drmike

100% Tier-1 Gogent
Does BTSync offer remote file view/preview without downloading the whole data set?

"... but it got pretty resource heavy scanning through 20 or 30k small files."

That's not a ton of files.  Those were spread out and not a single directory worth, right?
 

JahAGR

New Member
BTSync is good for small amounts of files. I tried experimenting with it for no-headaches backups but it got pretty resource heavy scanning through 20 or 30k small files. I use pretty low end boxes though.

I'm just back to using rsync. 
This is pretty much my experience. I threw about 2TB of files at it (idk how many individual files offhand) and it was slow to churn through all of them but the transfer speeds were good. I also went back to rsync :p
 

stim

New Member
I've been using BTsync with success for over a year, syncing data across 3 servers and my LAN. It has worked like a champ. 
 
Top
amuck-landowner