Publicly Availabe Dataset

This is a page where I have compiled public datasets that I have come across. 

1. http://hadoopilluminated.com/hadoop_illuminated/Public_Bigdata_Sets.html
2. http://www.researchpipeline.com/mediawiki/index.php?title=Main_Page 
3. http://www.scaleunlimited.com/datasets/public-datasets/
4. http://kevinchai.net/datasets  (good)
5. http://snap.stanford.edu/data/ 
6. http://labrosa.ee.columbia.edu/millionsong/
7. http://blogs.msdn.com/b/avkashchauhan/archive/2012/04/12/processing-million-songs-dataset-with-pig-scripts-on-apache-hadoop-on-windows-azure.aspx
8. https://stackoverflow.com/questions/10843892/download-large-data-for-hadoop
9. http://www.hadooplessons.info/2013/06/data-sets-for-practicing-hadoop.html
10. http://archive.ics.uci.edu/ml/datasets.html
11. http://lemurproject.org/clueweb09/
12. http://stackoverflow.com/questions/2674421/free-large-datasets-to-experiment-with-hadoop
13. 
    http://www.datasciencecentral.com/profiles/blogs/big-data-sets-available-for-free (good)
14. http://rishavrohitblog.blogspot.in/2013/02/sample-datasets.html
15. http://blog.cloudera.com/blog/2013/02/how-to-resample-from-a-large-data-set-in-parallel-with-r-on-hadoop/
16. 
    http://www.hadoopinrealworld.com/using-million-song-dataset-in-hadoop/
17. http://www.datawrangling.com/some-datasets-available-on-the-web/ (good)
18. spatialhadoop.cs.umn.edu/datasets.html
19. https://www.datadr.org/doc/airline.html
20. https://ibmhadoop.challengepost.com/details/data
21. http://musicmachinery.com/2011/09/04/how-to-process-a-million-songs-in-20-minutes/ 

Read More

Compiling Ethernet driver for RD9700 USB to ETHERNET ( Enter : E-100u ) in Ubuntu 14.04

I had bought a USB 10/100 Ethernet Adapter Enter: E-100u with RD9700 Version of Chipset. Previous version of Enter used "dm9601" driver, hence device was pre- configured for Ubuntu systems. Recent versions of these devices use "qf9700" driver but the driver file doesn't support on recent kernel. Compiling from the source shows lots of error.

I have edited the source - code and got it compiled for my system Ubuntu 14.04 , kernel: 3.17.8-031708-generic

Original source-code: www.pccables.com/drivers/RD9700Driver.zip
Modified:  qf9700.zip

Now run the following command in the source folder after extracting the source.


// run it in the extracted qf9700 folder
1) make
2) sudo cp qf9700.ko /lib/modules/`uname -r`/kernel/drivers/net/usb
3) depmod
4) modprobe usbnet
5) insmod /lib/modules/`uname -r`/kernel/drivers/net/usb/qf9700.ko

This will show a new eth'X ' in ifconfig.

X : be any number mine was 3. eg: eth3

Configure network interface:
nano -w /etc/network/interfaces
auto eth'X'
iface eth'X' inet dhcp
Restart network:
/etc/init.d/networking restart

And 'voila' you have your LAN connected.

Reference link:
1) https://mquin.livejournal.com/178482.html 
2) https://eyesonly666.wordpress.com/2012/10/15/compiling-linux-drivers-for-rd9700-qf9700-ko-under-debian-squeeze/

Read More

Let us make world better place to live

There is abundance of beauty in this world but it has problems, problems that could be solved. Some people become cops, work for NGOs, donate charity but we(Gajju and I) tried engineering.

The story began our group Abhinash, Vps, Gajju & I were arguing on the idea of how would a blind and deaf communicate each other. We managed to create crazy ideas but reached to simple solution "Text to Speech & Speech to Text". Avatar(orignal link) was a result of such chit-chat. Basically it was Gajju's idea to develop a technology that would help physically disabled- 'person without arm' to control their PC.

Disabled people constitute 2% our population with various physical disabilities . With such assistive technologies like Avatar at this low cot, these people can have world to grab. They can chat on facebook, hangout on google+, shop online, play computer games. The most important part is its design which barely  differs from simple goggle. Most of the designs developed make them feel they are in need of assistance but simple design of Avatar do not make so.

India trains around 5 to 6 lakhs engineers per year. Most of them are recruited by IT and manufacturing companies to develop their products. Supposedly even if 1% of them goes for innovation we could have a better to live. Every act of kindness makes a difference, we engineers could attempt one.

Read More