There seems to be dozens of ways to keep stuff in 2 places synchronized. Is there a better place than here to share tips on how to do it?
A brief overview of the many kinds of “stuff” that is helpful to synchronize:
(1) In theory there’s a little battery on the motherboard that keeps the clock ticking when the power goes out. In practice, that battery is drained after 3 or so years, and it’s less hassle to install nttp software than to pop it open and replace the battery (or to change the date from 1970 every time I unplug it).
Keeping multiple Macs in sync article by Ethan Marcotte.
“Linux on the Road: Data Transport Between Different Machines (Synchronization)” mentions:
“Disk-Based Backup & Recovery: Making Sense of Your Options” http://whitepapers.zdnet.com/abstract.aspx?docid=160631&promo=100503
“Subversion in my ~/Home” http://theadmin.org/articles/2006/04/05/subversion-in-my-home “Today I finished importing my home directory into Subversion. I did this because I needed an easy way to keep files in sync between my desktop and laptop and rsync was not cutting it.”
might be useful for keeping various fault-tolerant wiki servers synchronized … rsync http://samba.anu.edu.au/rsync/
consider emailing about “distributed wiki”, fault-tolerant data storage, etc. Andrew Tridgell http://samba.org/~tridge/ “I am interested in speech recognition, hidden Markov models, recurrent neural networks, parallel sorting, parallel searching, parallel filesystems, parallel operating systems, learning algorithms and networking protocols. If you are interested in the rsync algorithm then you may find my thesis useful.”
to read: perhaps it will help my distributed fault-tolerant data store Efficient Algorithms for Sorting and Synchronization thesis by Andrew Tridgell (describes rsync)
What is the difference between “mirrordir” and “rsync” ?
http://linas.org/theory/eternity.html “backup is tedious.” and many other good ideas for a distributed file system. “LAN-based RAID” … links to http://onionnetworks.com/products/ and “The Eternity Service” by Ross J. Anderson http://www.cl.cam.ac.uk/users/rja14/eternity/eternity.html … and “The XenoService? is a network of web hosts that can respond to an attack on a site by replicating it rapidly and widely.” http://www.cl.cam.ac.uk/~rja14/#Peer-to-Peer
“Voxnet is a java application designed to allow for the flow of uncensored encrypted information over the internet.” http://sourceforge.net/projects/voxnet/
“MUTE is a secure, anonymous, distributed communications framework. Node-to-node connections are encrypted, and messages are routed using an ant-inspired algorithm. The first MUTE-based app supports anonymous file sharing.” http://sourceforge.net/projects/mute-net/
Wikipedia:Gnutella “after a few days, the protocol had been reverse engineered, and compatible open-source clones began to appear. This parallel development of different clients by different groups remains the modus operandi of Gnutella development today.
“I2P.net and GNUnet.org and was reminded of MUTE-net.sf.net “ – recc. http://www.communitywiki.org/en/WikiFromScratchDiscussion
“"Availl Wide Area File Services (WAFS) software allows branch office users to access and share files over the WAN at LAN speeds. Its real-time multi-directional acceleration and mirroring technology ensures that the same data exists on all servers regardless of where changes occur.” sounds very similar to what I want.
“Entropy is a decentralized, peer-to-peer communication network designed to be resistant to censorship … It pools the contributed bandwidth and storage space of member computers … Entropy is designed to be compatible with the similar Freenet system.” http://en.wikipedia.org/wiki/Entropy_%28anonymous_data_store%29 uses the http://en.wikipedia.org/wiki/McEliece_cryptosystem
“Lotus Notes … It is typical to see one Notes “application” spanning 22+ servers, and users using this application globally. Changes are then replicated between all databases seamlessly, and asynchronously. It’ll work on a WAN, it’ll work on a modem, and it’ll work on the end of a satellite link. … Interestingly (from a developers perspective), the application code is actually compiled into the database itself, and replicates around. So as long as you have a client, you can play. … calendar, mirroring/multiple servers, offline capability … Domino (the server) and the Notes architecture in general may have accumulated a lot of cruft over the years, but it is an awesomely flexible and robust piece of work. You could implement a wiki in any number of languages on the Notes platform…” – Wiki:WikiWikiVsLotusNotes