Welcome! These forums will be deactivated by the end of this year. The conversation continues in a new morph over on Discord! Please join us there for a more active conversation and the occasional opportunity to ask developers questions directly! Go to the PS+ Discord Server.

Byzantium v0.1a (Scarab) Released!

7 posts / 0 new
Last post
Wed, 2012-01-11 23:16
#1
The Doctor The Doctor's picture
Byzantium v0.1a (Scarab) Released!
[url=http://www.hacdc.org/content/byzantium-v01a-scarab-released]Approved for: GENERAL RELEASE, DISTRIBUTION UNLIMITED[/url] [url=http://wiki.hacdc.org/index.php/Byzantium]Project Byzantium[/url], a working group of [url=http://hacdc.org/]HacDC[/url], is proud to announce the release of v0.1 alpha of Byzantium Linux, a live distribution of Linux designed to fulfill a crucial role in the evolution of the Internet. That role is a rapidly deployable ad-hoc wireless mesh network which can augment or replace the current telecommunications infrastructure in the event that it is knocked offline (for example, due to a natural disaster) or rendered untrustworthy (widespread surveillance or disconnection by hostile entities). Unlike other mesh networking projects Byzantium was designed to be run on any x86 computer with at least one 802.11 a/b/g/n wireless interface. Byzantium can be burned to a CD- or DVD-ROM (the .iso image is just over 300 megabytes in size), booted from an external hard drive, or can even be installed in parallel with an existing operating system without risk to the user's data and software. Byzantium Linux will then act as a node within the mesh and will automatically connect to other mesh nodes and act as an access point for WiFi-enabled mobile devices. THIS IS AN ALPHA RELEASE! Do NOT expect Byzantium to be perfect. Some features are not ready yet, others need work. Things are going to break in weird ways and we need to know what those ways are so we can fix them. Please, for the love of LOLcats, do not deploy Byzantium in situations where lives are at stake. FEATURES: [list] Binary compatible with Slackware v13.37, so existing packages can be converted with a single command. Able to act as a gateway to the Internet if a link is available. Linux kernel v2.6.38.8 Drivers for dozens of wireless chipsets KDE v3.5 LXDE (2010 release of all components) Mplayer GCC v4.5.2 Perl v5.12.3 Python v2.6.6 Firefox v4.0.1 X.org v7.4 (? - hard to tell because each module has its own release code) Custom web-based control panel [/list] SYSTEM REQUIREMENTS (to use) [list] Minimum of 512MB of RAM i586 CPU or better CD- or DVD-ROM drive BIOS must boot removable media At least one (1) 802.11 a/b/g/n interface [/list] SYSTEM REQUIREMENTS (for persistent changes) [list] The above requirements to use Byzantium 2+GB of free space on thumbdrive or harddrive [/list] WHAT WE NEED: [list] Developers. Developers! DEVELOPERS! No more Bill Ballmer impersonations. People downloading and running Byzantium to find bugs and tell us where the problems are so we can fix them. People filing bug reports on [url=https://github.com/Byzantium/Byzantium]our Github page[/url]. We can't fix what we don't know about! People submitting patches. People booting Byzantium and setting up small meshes (2-5 clients) to tell us how well it works for you with your hardware. We have a hardware compatibility list on our wiki that needs to be expanded. People who can help us translate the user interface. We especially need people fluent in dialects of Chinese, Arabic, Farsi, and Urdu. People to help us write and translate documentation. [/list] [url=http://wiki.hacdc.org/index.php/Byzantium]Homepage[/url] (website coming soon) [url=http://wiki.hacdc.org/index.php/Downloading_Byzantium]Download sites[/url] CODA: You are probably wondering what, if any relevance this has to [u]Eclipse Phase[/u]. One of the biggest inspirations for Project Byzantium was the Mesh of [u]Eclipse Phase[/u], and it is likely that, had a few of us not fallen in love with the RPG we would never have remembered learning about mobile IP or mesh routing protocols in undergraduate network programming class. So, we thank everyone who worked on [u]Eclipse Phase[/u] for all of your hard work.
—
[img]http://drwho.virtadpt.net/graphics/info_userbar.jpg[/img] [img]http://drwho.virtadpt.net/graphics/argo_userbar.jpg[/img] [url=https://drwho.virtadpt.net/graphics/blankbadge.png][img]http://drwho.vir...
Top
Sat, 2012-01-14 15:49
Decivre Decivre's picture
Re: Byzantium v0.1a (Scarab) Released!
This is an awesome idea, and one I absolutely hope you guys can get off the ground. I haven't done any OS coding before, but if there's anything I might be able to do to help, I'd like to. On a secondary note, I have a rather Extropian suggestion for this OS; you might want to make this capable of secondary anonymous internet protocols such as i2p, Tor, Freenet, and others that I can't remember; after all, if you are trying to make a mesh system that is more durable than currently existing wireless topologies, you might as well go the extra mile and make it feasible for users to be more trace resistant as well (one way to take down a network is to find its users).
—
Transhumans will one day be the Luddites of the posthuman age. [url=http://bit.ly/2p3wk7c]Help me get my gaming fix, if you want.[/url]
Top
Sat, 2012-01-14 23:50
The Doctor The Doctor's picture
Re: Byzantium v0.1a (Scarab) Released!
Decivre wrote:
This is an awesome idea, and one I absolutely hope you guys can get off the ground. I haven't done any OS coding before, but if there's anything I might be able to do to help, I'd like to.
If you are knowledgable in Python, Erlang, PHP, or shell scripting, we could definitely use your help. We also need help with writing documentation and fine-tuning the quickstart guide so that it make sense.
Decivre wrote:
On a secondary note, I have a rather Extropian suggestion for this OS; you might want to make this capable of secondary anonymous internet protocols such as i2p, Tor, Freenet, and others that I can't remember; after all, if you are trying to make a mesh system that is more durable than currently existing wireless topologies, you might as well go the extra mile and make it feasible for users to be more trace resistant as well (one way to take down a network is to find its users).
We do have such plans in mind, though they are likely going to wait until the beta releases start (probably >= v0.3). We plan to make it possible for network gateways to route traffic over the Tor network, and we are evaluating a number of other darknets for usability and feasibility (as well as VPNs). Keep in mind that most of our use cases involve not having net.access (or at least, reliable net.access), so we aim to replicate a subset of that functionality in the applications that Byzantium nodes provide. A mesh's users being found are a concern of ours. Our threat model was developed in collaboration with activist groups around the world, and it involves not users being tracked down but nodes/access points being tracked down (which happened rather a lot in 2011 in Syria), hence, designing for mobility, long distance links and rapid shutdown if need be.
—
[img]http://drwho.virtadpt.net/graphics/info_userbar.jpg[/img] [img]http://drwho.virtadpt.net/graphics/argo_userbar.jpg[/img] [url=https://drwho.virtadpt.net/graphics/blankbadge.png][img]http://drwho.vir...
Top
Sun, 2012-01-15 07:26
Decivre Decivre's picture
Re: Byzantium v0.1a (Scarab) Released!
The Doctor wrote:
If you are knowledgable in Python, Erlang, PHP, or shell scripting, we could definitely use your help. We also need help with writing documentation and fine-tuning the quickstart guide so that it make sense.
Unfortunately, most of my coding skills are in the C languages, MySQL and Javascript, though I am learning Python and am at least nominally skilled at shell script. I might be more useful in documentation for the time being.
The Doctor wrote:
We do have such plans in mind, though they are likely going to wait until the beta releases start (probably >= v0.3). We plan to make it possible for network gateways to route traffic over the Tor network, and we are evaluating a number of other darknets for usability and feasibility (as well as VPNs). Keep in mind that most of our use cases involve not having net.access (or at least, reliable net.access), so we aim to replicate a subset of that functionality in the applications that Byzantium nodes provide.
Agreed. Some means of maintaining decentralized networks, with every Byzantium node being capable of acting as a server would be an interesting way to maintain communication when the network is cut off from the greater internet. So users might be able to use such programs as IRC (which if memory serves is decentralized) or eMule to interlink with users on whatever size topology can be maintained. It might also be wise to make Byzantium capable of caching parts of the internet, so that internet users can at least view a backup of websites while the network is cut off from the world. How you might design Byzantium to determine which parts of the internet to cache, I have no clue.
The Doctor wrote:
A mesh's users being found are a concern of ours. Our threat model was developed in collaboration with activist groups around the world, and it involves not users being tracked down but nodes/access points being tracked down (which happened rather a lot in 2011 in Syria), hence, designing for mobility, long distance links and rapid shutdown if need be.
For rapid shutdown, steps can be taken to ensure that the operating system's integrity can be maintained even with power being cut. For small hard drives, the current configuration works quite well. You might want to also make a stripped-down version of Byzantium down the line that is capable of being started via disk, then allowing that disk to be removed so that the entire OS is simply held on RAM until shutdown (of course there will have to be a minimum requirement, but I'm sure that with work you can get it below Windows XP requirement levels). For larger hard drives and major nodes that such groups might set up, parity code combined with RAID support or even the capability for "false RAID" data storage (mirrored storage of data on a single hard drive; a friend once jokingly called it SLED, for Single Large Expensive Drive, but I don't think he invented that term) would do wonders for making quick shutdown an easy task. This support for large hard drives would also be very handy, should you implement the internet cache I was mentioning earlier.
—
Transhumans will one day be the Luddites of the posthuman age. [url=http://bit.ly/2p3wk7c]Help me get my gaming fix, if you want.[/url]
Top
Fri, 2012-01-20 16:03
The Doctor The Doctor's picture
Re: Byzantium v0.1a (Scarab) Released!
Decivre wrote:
Unfortunately, most of my coding skills are in the C languages, MySQL and Javascript, though I am learning Python and am at least nominally skilled at shell script. I might be more useful in documentation for the time being.
Help with documentation (in particular, The Book) would be great. Also, there are a couple of things that could use some automation, such as hardening and building the actual OS package. Are you on the mailing list?
Decivre wrote:
Agreed. Some means of maintaining decentralized networks, with every Byzantium node being capable of acting as a server would be an interesting way to maintain communication when the network is cut off from the greater internet. So users might be able to use such programs as IRC (which if memory serves is decentralized) or eMule to interlink with users on whatever size topology can be maintained.
IRC is decentralized... sort of. Servers are capable of connecting to one another to relay traffic from node to node so that users can be spread across a large area of net.space without overloading any one server's socket capacity. The problem with most IRC servers is that they have to be specifically configured to federate with one another. The one we are using appears to do so automatically with mDNS but we have not tested it yet, and there are other options that we are going to investigate soon.
Decivre wrote:
It might also be wise to make Byzantium capable of caching parts of the internet, so that internet users can at least view a backup of websites while the network is cut off from the world. How you might design Byzantium to determine which parts of the internet to cache, I have no clue.
We are toying with the idea of adding a caching transparent web proxy that can be turned on and off, but disk space and memory to contain the cache and indices is at a premium with a live OS.
Decivre wrote:
You might want to also make a stripped-down version of Byzantium down the line that is capable of being started via disk, then allowing that disk to be removed so that the entire OS is simply held on RAM until shutdown (of course there will have to be a minimum requirement, but I'm sure that with work you can get it below Windows XP requirement levels).
That functionality already exists actually, we have just not exercised it strongly yet. The underlying distribution ([url=http://porteus.org/]Porteus Linux[/url]) includes a "RAM only" feature which does just that.
Decivre wrote:
For larger hard drives and major nodes that such groups might set up, parity code combined with RAID support or even the capability for "false RAID" data storage (mirrored storage of data on a single hard drive; a friend once jokingly called it SLED, for Single Large Expensive Drive, but I don't think he invented that term) would do wonders for making quick shutdown an easy task. This support for large hard drives would also be very handy, should you implement the internet cache I was mentioning earlier.
Installing to a journalled file system (like EXT3 or EXT4) is definitely an option. I think we can do some experiments fairly soon to see how well this work. I even have a dataset in mind for them...
—
[img]http://drwho.virtadpt.net/graphics/info_userbar.jpg[/img] [img]http://drwho.virtadpt.net/graphics/argo_userbar.jpg[/img] [url=https://drwho.virtadpt.net/graphics/blankbadge.png][img]http://drwho.vir...
Top
Sat, 2012-01-21 22:20
Decivre Decivre's picture
Re: Byzantium v0.1a (Scarab) Released!
The Doctor wrote:
Help with documentation (in particular, The Book) would be great. Also, there are a couple of things that could use some automation, such as hardening and building the actual OS package. Are you on the mailing list?
No, I can't say I am. I will probably join it soon.
The Doctor wrote:
IRC is decentralized... sort of. Servers are capable of connecting to one another to relay traffic from node to node so that users can be spread across a large area of net.space without overloading any one server's socket capacity. The problem with most IRC servers is that they have to be specifically configured to federate with one another. The one we are using appears to do so automatically with mDNS but we have not tested it yet, and there are other options that we are going to investigate soon.
If that's the case, this might call for some new chat protocol. This mesh network would provide an excellent testing ground for a truly decentralized chat network that has its backbone built entirely on these mesh servers (and anything else on the internet that is running the chat software).
The Doctor wrote:
We are toying with the idea of adding a caching transparent web proxy that can be turned on and off, but disk space and memory to contain the cache and indices is at a premium with a live OS.
I would recommend disabling that feature with a live install, and making it active only on an actual hard drive install. Web caching is very memory-intensive, and it could potentially act like a memory leak for a live install (as the caching rapidly eats up RAM without freeing it until shutdown or restart).
The Doctor wrote:
That functionality already exists actually, we have just not exercised it strongly yet. The underlying distribution ([url=http://porteus.org/]Porteus Linux[/url]) includes a "RAM only" feature which does just that.
Probably for the best. You might want to wait until beta before rolling out a feature like that.
The Doctor wrote:
Installing to a journalled file system (like EXT3 or EXT4) is definitely an option. I think we can do some experiments fairly soon to see how well this work. I even have a dataset in mind for them...
D'oh! I forgot about journaling file systems. EXT4 is probably the best course, at least so long as there are still plans to make it defragmentable while live (I don't think they've finish building that feature yet).
—
Transhumans will one day be the Luddites of the posthuman age. [url=http://bit.ly/2p3wk7c]Help me get my gaming fix, if you want.[/url]
Top
Tue, 2012-01-24 21:35
The Doctor The Doctor's picture
Re: Byzantium v0.1a (Scarab) Released!
Decivre wrote:
If that's the case, this might call for some new chat protocol. This mesh network would provide an excellent testing ground for a truly decentralized chat network that has its backbone built entirely on these mesh servers (and anything else on the internet that is running the chat software).
There are a few of them out there already, but the most mature of them is actually XMPP. We are considering using ejabberd for a number of functions, such as distributed realtime chat (that plug-in comes with the source tree), microblogging (same), and user-to-user instant messaging. I believe that ejabberd instances can be configured to automatically find one another, but if they cannot then we may have a little more code to write. Implementing a mobile-friendly front-end should not be difficult.
Decivre wrote:
I would recommend disabling that feature with a live install, and making it active only on an actual hard drive install. Web caching is very memory-intensive, and it could potentially act like a memory leak for a live install (as the caching rapidly eats up RAM without freeing it until shutdown or restart).
Most of the services we have are off by default (right now, anyway), and have to be enabled by the administrator. We could add a few checks to determine how the node is running and disable that option or not.
Decivre wrote:
D'oh! I forgot about journaling file systems. EXT4 is probably the best course, at least so long as there are still plans to make it defragmentable while live (I don't think they've finish building that feature yet).
I do not know. I need to do some more research on EXT4 (it is a little too close to the bleeding edge for my tastes at this moment).
—
[img]http://drwho.virtadpt.net/graphics/info_userbar.jpg[/img] [img]http://drwho.virtadpt.net/graphics/argo_userbar.jpg[/img] [url=https://drwho.virtadpt.net/graphics/blankbadge.png][img]http://drwho.vir...
Top