>> 10 new open source projects and developments, worth knowing about
-
I have released an open source project on Github :
https://github.com/wrapperband/OpenTrafficSurvey
Open Traffic Survey
Introduction to a citizen Traffic Survey Methodology
The aim of Open Traffic Survey is to outline a procedure which retains un-tamperable (video) evidence of Traffic characteristics and provide an open source spreadsheet into which data can be input and visualised with charts.
Open Traffic Survey : History of development
The Open Traffic Survey is the result of “6 years work” (not contiguous) monitoring and analysing the traffic on a minor road in Oldham.
The methodology arises from long term notes on how A.I. or Machine Learning techniques could assist in continuous environmental surveys such as traffic levels. i.e. it is an open source project to enable citizen environmental monitoring, contributions welcome.
The necessity to start manual analysis and record keeping arose out of the requirement of a local planning action group to have some source of “provable in court” information on the environment and how it was changing. That investigation resulted in various charts and calculations to show/ visualise the true effect of “average vehicle flows” being experienced.
-
OnionTip
Firstly an interesting project in it’s self, but could also have a page that accepts pays FTC?
Also, could be financed by bounty to kick off …
OnionTip
Donate to volunteers who are running Tor relays which support a powerful tool that helps you stay anonymous online.
https://oniontip.com/#?exit_filter=all_relays&links&sort=cw&sort_reverse&country=+
-
@wrapper said:
OnionTip
Firstly an interesting project in it’s self, but could also have a page that accepts pays FTC?
Also, could be financed by bounty to kick off …
OnionTip
Donate to volunteers who are running Tor relays which support a powerful tool that helps you stay anonymous online.
https://oniontip.com/#?exit_filter=all_relays&links&sort=cw&sort_reverse&country=+
Why not combine running tor relay with mining tor coins?
Proof of bandwidth :) -
Actiona is a task automation tool. It allows you to create and execute action lists.
You don’t need to know any programming language to use it: its intuitive interface allows you to create action lists (scripts) using drag & drop.
Advanced users can use JavaScript (EcmaScript) to extend its functionality.
Actiona is free software and runs under Windows and GNU/Linux. Binaries are available for Windows and Ubuntu for both 32 and 64 bits. The program is developed in C++ and uses the Qt framework.
sudo apt-get install actionaz
-
LXD - The Linux container hypervisor
Just been trying these new Linux based container technology LXD. It should make an easy to package to known distribution configuration, snapshot, deploy applications and update them.
The online demonstration and documents show the command line tools available. Pretty mind bending …
https://linuxcontainers.org/lxd/try-it/
What is LXD (“lex‐dee”)?
Imagine you could launch a new machine in under a second, and that you could launch literally hundreds of them on a single server. Now, imagine hardware‐guaranteed security to ensure that those machines can’t spy on one another. Imagine you can connect them separately and securely to networks. And imagine that you can run that on a single node or a million, live migrate machines between those nodes, and talk to all of it through a clean, extensible REST API.
By combining the speed and density of containers with the security of traditional virtual machines, Canonical’s LXD is the next‐generation of container hypervisor for Linux.
-
TreeSheets
This has made me feel a complete idiot that I have never heard of TreeSheets!
The ultimate replacement for spreadsheets, mind mappers, outliners, PIMs, text editors and small databases.
Suitable for any kind of data organization, such as Todo lists, calendars, project management, brainstorming, organizing ideas, planning, requirements gathering, presentation of information, etc.
It’s like a spreadsheet, immediately familiar, but much more suitable for complex data because it’s hierarchical.
It’s like a mind mapper, but more organized and compact.
It’s like an outliner, but in more than one dimension.
It’s like a text editor, but with structure. -
Flatpak - The future of application distribution
Flatpak has been created to be an open source “Container” / “Package manager” solution, making it easy for developers to release a cross platform version of software.
Flatpak is the new framework for desktop applications on Linux
Distributing applications on Linux is a pain: different distributions in multiple versions, each with their own versions of libraries and packaging formats. Flatpak is here to change all that. It allows the same app to be installed on different Linux distributions, including different versions. And it has been designed from the ground up with security in mind, so that apps are isolated from each other and from the host system.
The days of chasing multiple Linux distributions are over. Standalone apps for Linux are here!
-
pass
the standard unix password manager
Password management should be simple and follow Unix philosophy. With pass, each password lives inside of a gpg encrypted file whose filename is the title of the website or resource that requires the password. These encrypted files may be organized into meaningful folder hierarchies, copied from computer to computer, and, in general, manipulated using standard command line file management utilities.
pass makes managing these individual password files extremely easy. All passwords live in ~/.password-store, and pass provides some nice commands for adding, editing, generating, and retrieving passwords. It is a very short and simple shell script. It’s capable of temporarily putting passwords on your clipboard and tracking password changes using git.
-
Ever required a table of contents in your Mark Down documents?
DocToc automatically produces a table of contents (Toc) at any position in your document.
Generates table of contents for markdown files inside local git repository. Links are compatible with anchors generated by github or other sites via a command line flag.
-
Grip – GitHub Readme Instant Preview
Render local readme files before sending off to GitHub.
Grip is a command-line server application written in Python that uses the GitHub markdown API to render a local readme file. The styles come directly from GitHub, so you’ll know exactly how it will appear. Changes you make to the Readme will be instantly reflected in the browser without requiring a page refresh.
MotivationSometimes you just want to see the exact readme result before committing and pushing to GitHub.
-
ULAM - Programming language using “artificial life techniques”
ULAM
Just watched this amazing video by David Ackley [Ref 1] showing some “artificial life” demonstrated with a program written in his new programming language MFM.
MFM (Movable Feast) and it’s compiler ULAM has been designed to be infinity scale able. The MFM language breaks down the operation of “computing” into basic points which contain the minimum amount of information and compute (or act) solely by interaction with their nearest neighbors.
Thes can be used to generate stable self replicating patterns of “behaviours” which are intrinsically self healing and self aligning to the task since the “life and death” of processes is built into its natural operation.
David Ackley - Artificial Life for Bigger & Safer Computing
https://www.youtube.com/watch?v=NqSnoJ-VGH4#t=1038.959125Quote :
This codebase implements a simulator; and, hopefully one day
soon, board support for actual hardware for a computer
architecture known as the “Movable Feast Machine” (MFM).The MFM is an indefinitely scalable computer architecture, meaning
that the underlying hardware is organized as a tile that can
be duplicated and plugged together to form an arbitrarily large
machine, without ever running into any a priori design
limit such as running out of addresses.The current version ULAM 2, includes a graphical programming interface.
I think of it as an early 2D version of the programming language used by the mice in “Hitchhickers Guide to the Galaxy”.
For Ubuntu
sudo add-apt-repository ppa:ackley/mfm sudo apt-get update sudo apt-get install ulamRunning the built in Demo “Example Environments”
List of available MFM demos
/usr/bin/mfzrunFrom the demo list : run PredatorPrey
mfzrun PredatorPrey demoRunning the compiler
https://github.com/elenasa/ULAM/wiki/Ulam-Programming-Language
Downloading the demo’s code
git clone https://github.com/elenasa/ULAM.git
David Ackley’s presentation on the philosophy and development of ULAM
David Ackley - Presentation Youtube - Including Ulam Hardware
[Ref 1]
David Ackley
David Ackley is an associate professor of Computer Science at the University of New Mexico, with degrees from Tufts and Carnegie Mellon. Over twenty-five years my work has involved neural networks and machine learning, evolutionary algorithms and artificial life, and biological approaches to security, architecture, and models of computation.@DavidAckley
Over the last 70 years, ever more powerful computers have revolutionized the world, but their common architectural assumptions—of CPU and RAM, and deterministic program execution—are now all hindrances to continued computational growth.Many common networking assumptions—such as fixed-width addresses and globally unique node names—are likewise only finitely scalable.
Life is a self-repairing, space-filling, programmable computing system. For that reason, artificial life principles and software will be central to future large-scale computer architectures. But today, most software ‘alife’ models are siloed in their own unique computational universes, hampering engineering interoperability and scientific generalization.
-
NetLogo
NetLogo is a multi-agent programmable modeling environment. It is open source and written in java so it is cross platform.
It is used by tens of thousands of students, teachers and researchers worldwide. It also powers HubNet participatory simulations. It is authored by Uri Wilensky and developed at the CCL. You can download it free of charge.
http://ccl.northwestern.edu/netlogo/
-
First of all here is an amazing “sketch” from OpenProcessing
http://openprocessing.org/sketch/48672
I’ve never heard of open processing before until I saw a few projects on Github using “Processing” and wondered what it was. It turns out to be so “old” it has sketches that aren’t compatible with the latest Version 3!
Open Processing is a site that hosts “Sketches” made using the graphical processing language, “Processing”.
Open Processing is a website to share Processing sketches
- share your sketches with others
- help and collaborate with the community
- improve and polish your programming skills
- follow classes around the world teaching processing*
Processing is an open source programming language and environment for people who want to program images, animation, and interactions. It is an open project initiated by Ben Fry and Casey Reas. It can be downloaded from processing.org , they ask for a donation but it can be downloaded for free. All the “Sketches” and code snippets on Open Processing are open source.
-
I’ve been interested in A.I. computational techniques since I used them in my PhD in 1984 (Newtownian Regression).
So I have been following the development of open source machine learning tools. One of the most interesting to me as a hacker coder was char-rnn, which allowed you to train a artificial neural net from a text file. This is limited by size of graphics card and it’s specific “Learn to write like Shakespeare demo” of A.I possibilities.
A lot of what comes out depends on training, as the brain is so small. It is very interesting to see what it picks up and what it doesn’t.
Songster : Machine Learning Guitar Tab / Song Writer
Currently Songster has just over the amount of data to learn “English”, learned rudimentary chord key applicability, Some song structure. It is clear from the experiments, up to now, that further increase to the training data would be advantageous.
Also previous brains have been better at the actual Guitar Tabs, especially after I went through and standardized the guitar string description in the training data.
Like us (humans), if you say Sargent Peppers , there isn’t much option but to say Heartclub. However, more data would mean I can lower the probability (sample).
Any ideas of good alternate lyrics, I’m gradually adding extra tabs.
Moving to torch-rnn from char-rnn
The main advantage of moving from char-rnn to torch-rnn has been the size of the brain that is possible. With char-rnn and a R9 290 it was restricted to 400 neurons, but with torch, so far have achieved 1400 neuran brain, with 256 input or layer width.
One of the other advantages of moving to torch-rnn from Songster26 onwards, is it has a “bench sampling” probability.
So it can be a bit more, random over words" but tight on spelling. torch-rnn also allows a bigger brain, which had some differences, but are quite subtle improvements in the Tab structure.
I like retaining the “noise”, to see what it adds to the creative process, i.e. it could be worth adding / experimenting some abc or midi files.
Once I have a lot more training data, we’ll also start it with a bigger brain. It will be interesting to see how much further improvement that gives (to its song “understanding”).
Near future of co-perative or trainable systems
It is now possible to set up a computer as a robot, for instance, I want to create a Robot Drummer. Instead of arms it would play midi.
The robot drummer can be trained by “making it drum to training music” then training it to reduce the difference between a recording of training music plus drumming and the original training music.
The advantage of the robot drummer over a drum machine, will be the flexibility It will also be able to automatically play an appropriate beat, as you jam along. Another advantages it the system could continue to learn, you could teach it your music specifically.
Where to find the source code, torch-rnn
https://github.com/jcjohnson/torch-rnn
What next?
I have a number of sample outputs yet to study (39 to 44). So far, it seems like you get a couple of stonkin, if complex tunes per 500kb sample and full probability. Bit like hyper Yes or REM on steroids.
Update : A few musicians have now approached me and I have allocated them a specific out-put sample, from Songster, for inspiration / study.
I have done some work to improve the training data, sharpen out “noise” and add some more tabs, could do with a bit more before rebuilding the PCs for some more training runs.
Here’s a couple of Songster27s song Tabs, from sample 38.
The Bridge by Slach Para loud and the Pharacancy scabins pop key A E A E F#m E A D A D He's a battle light away from the machined will bring it G D E talking tided of the precious of your painting sticking E E G B No one caracope like the dictaked little cops C3 G Flashing crosses at the chance it was you A E Birthday lasty F# B7 D A Badd1oo-ooo-ooo, he's with a sil-s? BRIDGE F#m The women really understands, F#m F# Bm When the jeat dark as a crowd a-dur-da-dor F#m C#m7 Get it again, they call me the bright D Bm E Blinded by the light she ran, unhibleand also from Songster27.38 without a title :
Everything we did was tries by Songster27 slow ballad lament key C C Gm7 F F everything we did was tries it a stand now .. Dm7 F Em Dm7 C Fmaj7 C F7 time all to be to be Am Em7 F B7/D# But honey for the steal, I was wrong at your lover Fmaj7 Let my feels beach one selves has go. (Repeat and fade) -
Something I’ve been waiting to find, to have an open source solution to Task and Request tracking. RT also covers inventory, email analysis and auto job creation.
RequestTracker (RT)
RT is an enterprise-grade issue tracking system. It allows organizations
to keep track of what needs to get done, who is working on which tasks,
what’s already been done, and when tasks were (or weren’t) completed.RT doesn’t cost anything to use, no matter how much you use it; it is
freely available under the terms of Version 2 of the GNU General Public
License.RT is commercially-supported software. To purchase support, training,
custom development, or professional services, please get in touch with
us at [email protected].Install on Ubuntu
sudo apt install request-tracker4 -
Peer to Peer software development
One thing about blockchain technology is how it is “ready to go”, unlike most other technologies, early adopters, alt-coins have quickly demonstrated how it can be used.
Now it seems every good peer to peer idea I look have has a 2 year old initial implementation.
The DMCA takedowns of Github produced some very interesting developments which are relevant today, especially with tracking of IP addresses by the state.
Gitchain Decentralized P2P Git Network
“Git is a free and open source distributed version control system designed to handle everything from small to very large projects with speed and efficiency.”
Gitchain is an application of ideas behind Bitcoin, Namecoin and DHT applied to Git hosting. Once you install it, it acts as a local proxy to the entire Gitchain P2P network.
http://gitchain.org/https://github.com/gitchain/gitchain
GitTorrent: A Decentralized GitHub — May 29, 2015
Chris Ball says :
I’ve been working on building a decentralized GitHub, and I’d like to talk about what this means and why it matters — and more importantly, show you how it can be done and real GitTorrent code I’ve implemented so far.
Why a decentralized GitHub?
First, the practical reasons: GitHub might become untrustworthy, get hacked — or get DDOS’d by China, as happened while I was working on this project! I know GitHub seems to be doing many things right at the moment, but there often comes a point at which companies that have raised $100M in Venture Capital funding start making decisions that their users would strongly prefer them not to.
http://blog.printf.net/articles/2015/05/29/announcing-gittorrent-a-decentralized-github/
https://github.com/cjb/GitTorrent
Also, a decentralized, distributed package manager:
-
Diffoscope
When auditing or merging open source software it is often necessary to do some sort of difference between the projects. This is where tools such as diff or diffoscope come in.
diffoscope is developed as part of the “reproducible builds” Debian project and was formerly known as “debbindiff”
diffoscope can intelligently identify the difference between files, by knowing and comparing files within their formats. It’s available in most repositories.
It recursively unpacks archives of many kinds and transform various binary formats into more human readable form to compare them. It can compare two tarballs, ISO images, or PDF just as easily.
diffoscope can be scripted through error codes, and a report can be produced with the detected differences. The report can be text or HTML. When no type of report has been selected, diffoscope defaults to write a text report on the standard output.
http://manpages.ubuntu.com/manpages/xenial/man1/diffoscope.1.html
-
I was looking for fractal generators for Linux (test my PC speed before meltdown patch) and came across this 3D generator I haven’t seen before :
What is Mandelbulber?
Mandelbulber is an experimental application that helps to make rendering 3D Mandelbrot fractals much more accessible. A few of the supported 3D fractals: Mandelbulb, Mandelbox, BulbBox, JuliaBulb, Menger Sponge, Quaternion, Trigonometric, Hypercomplex, and Iterated Function Systems (IFS). All of these can be combined into infinite variations with the ability to hybridize different formulas together.
-
looks nice…
-
I was looking something to benchmark my PC before meltdown gets fixed and came across this : stress-ng.
It contains over 180 stress tests that allow one to measure throughput on various system components, from memory, cache, CPU, system calls, network, etc. Install on Ubuntu with:
sudo apt-get install stress-ngThere is a --metrics-brief option that reports the throughput in terms of bogo ops per second. One can get a full set of deep CPU and system metrics using the --perf option. There are many types of stressors that can be run sequentially or in parallel on 1 or more CPUs, for example:
stress-ng --metrics-brief --cpu 2 -t 1mthis will exercise the CPU for 1 minute with 2 CPU stressor instances running in parallel.
