It's just as a domain for this pile of scripts.
##0. Perl Perl is just because every single system admin that I respect (like Urchlay from ##slackware), recommended me to learn Perl. Now when I started I cannot explain it yet, but I already feel why. ##1. Concept of The System This is not yet for datamining. It's just improving the ability to get right knowledge while wasting no time for for browsing web. Datamining is hardcore. This is just 50/50 manual/auto work.
- Multiple Data Extraction tools for specific API's or sources, ruthless and simple.
- IRC Bot for CLI to all data extraction tools as well as for logging, archiving and most importantly command and control C5I.
- Planning for automated data analysis will be necessary only after building a good basis of data extraction. So data extraction is top-priority. And it will help us to learn the patterns of data that we seek to convert into knowledge.
##2. In progress
- Perl Simple IRC Bot for command and control C5I.
- Perl yellowAPI - data extractor. module
- Perl Facebook API data exchange module.
##3. To-do
- Pinterest API data extractor module
- google+ API data extractor module
- skype API data exchange module
- ....
##4. System Architecture based on Systems Thinking
It is in progress, but just to name a few basic principles:
- Keep it Simple Stupid
- Security Trough Simplicity and Transparency
- Flexibility - By being able to replace any part(script) of the System quickly.
- Efficiency - By automating every single boring task if possible.
- Keeping system attack surface from minimal to invisible, by reducing human element and promoting the practice of The Fifth Discipline