BTSync - Bittorrent Sync file replication Mega Thread

[drmike]

Appears that a bunch of us are experimenting with file replication solutions lately or maybe have such running for a bit.

This is for BTSync / Bittorrent Sync.

Some questions:

1. Anyone successfully running BTSync on a LAN/WAN on all internal IP arrangement?   Does it work with such or does it need to speak to the public internet all the time?

2.  Who has a successful and straightforward install process for BTSync on Debian / related systems?

 

[rmlhhd]

Works great on Debian and Ubuntu

 

[mikeyur]

I've successfully installed it a few times using the yeasoft repository: http://www.yeasoft.com/site/projects:btsync-deb:btsync-server

I setup a default instance and go through the guided install. Easy enough.

 

[splitice]

Install is simple. Server deployment in our case is done via shell script. Currently not using a repository.

To install:

1. Optional: Create user for btync to run as (or group and add your own user to it etc)
2. Copy btsync to directory
3. chmod +x btsync
4. copy confifguration file in
5. Add init.d script
6. update-rc.d [init script] defaults
7. Optional: Change client name in configuration file (can be automated with sed)
8. Run

Nothing too complex is required. Its basically a single binary service with a configuration file.

Note you have to run the same version on all servers. Be sure to disable the update prompts on windows as they will get annoying.

 

[drmike]

I've successfully installed it a few times using the yeasoft repository: http://www.yeasoft.com/site/projects:btsync-deb:btsync-server

I setup a default instance and go through the guided install. Easy enough.

Alright, now we are cooking with fuel....   repository about to be added and some testing in a bit  THANK YOU!

 

[HalfEatenPie]

Just for clarification purposes.

Btsync is basically a Dropbox alternative that uses the bittorrent protocol right?

How is it for large files?  And for files that are constantly being changed from many locations?  

 

[splitice]

Large files - no problem. Its bittorent so its chunked.

Constantly changing is problematic, seems to use timestamps to resolve conflicts. If time is out of sync at any node seems to cause major issues.

 

[sv01]

for large files no problem, but for files that are constantly change, btsync will complain (I test on file log, that change every few second)

btw now I'm moving to Syncthing

 

[drmike]

Well Syncthing *looks* nice, but they are shipping updates darn near daily.

Android version installed and nothing configged and it's taking a chunk of battery. Meh.  Android the OS that will bring back the backphone battery

@sv01

"but for files that are constantly change, btsync will complain (I test on file log, that change every few second)"

So, what does BTSync do with these?  What breaks and if the updates were less frequent, do you think btsync would catch up?

 

[sv01]

Well Syncthing *looks* nice, but they are shipping updates darn near daily.

Android version installed and nothing configged and it's taking a chunk of battery. Meh.  Android the OS that will bring back the backphone battery

@sv01

"but for files that are constantly change, btsync will complain (I test on file log, that change every few second)"

So, what does BTSync do with these?  What breaks and if the updates were less frequent, do you think btsync would catch up?

I never use Synthing android app before and that port unofficially. 

If your file changes not as fast as file log nothing wrong there, both BTSync and Syncting can't sync these file correctly. I test against file log because I want to know how they handle file that changes really fast but both of them failed.

For my multimedia, backup and configuration files both working just fine. Nothing to complain.

 

[drmike]

Well I just got daring and spun up a new remote VPS to fuss with Syncthing.... It's damn nifty once you figure out the plumbing.  It's a bit slow getting started and figuring out what to config and where.

Web interface on it too [built in]  pops open on localhost which is dumb on remote servers and lacks any username/password by default and one must manually go find such and be diligent.   Both items need addressed by development.

A proper repository version would be nice too [for Debian of course]....

Their peer discovery is nice, albeit it slow.  Placing in this case the remote IP for the VPS in the config is much faster on initiating communications and getting files moving.

I am going to commit a portion of the next week to getting comfortable with Syncthing.

 

[AThomasHowe]

BTSync is good for small amounts of files. I tried experimenting with it for no-headaches backups but it got pretty resource heavy scanning through 20 or 30k small files. I use pretty low end boxes though.

I'm just back to using rsync. 

 

[splitice]

Unfortunately I concur, we ended up syncing archives. Wasn't a big issue in the end since those archives became our packages and in the end it was cleaner for it.

Plus permissions can be preserved

 

[mojeda]

I used btsync with over 6GBs of media files, audio, video, PDF, etc and it worked pretty good.

One of the things I like was that servers would sync from each other and not just one server.

 

[drmike]

Does BTSync offer remote file view/preview without downloading the whole data set?

"... but it got pretty resource heavy scanning through 20 or 30k small files."

That's not a ton of files.  Those were spread out and not a single directory worth, right?

 

[JahAGR]

BTSync is good for small amounts of files. I tried experimenting with it for no-headaches backups but it got pretty resource heavy scanning through 20 or 30k small files. I use pretty low end boxes though.

I'm just back to using rsync. 

This is pretty much my experience. I threw about 2TB of files at it (idk how many individual files offhand) and it was slow to churn through all of them but the transfer speeds were good. I also went back to rsync

 

[johnlth93]

LAN network works just fine, tried it between my laptop and my phone

 

[stim]

I've been using BTsync with success for over a year, syncing data across 3 servers and my LAN. It has worked like a champ. 

 

[drmike]

I've been using BTsync with success for over a year, syncing data across 3 servers and my LAN. It has worked like a champ. 

Good endorsement!

Rough estimate on total chunk of disk shared?

 

[incloudibly]

Btsync is basically a Dropbox alternative that uses the bittorrent protocol right?

Yes, except for you are free to choose where to store your files at and no third party has access to this data.