Category Archives: Software Engineering

Becoming Student at 41

After college I went to start working for software development companies in Tehran. They almost were the best ones in their business. Originally my plan was to go back to grad school after a few years. Time flies when you … Continue reading

Posted in Software Engineering | Leave a comment

Running HDFS on an Ubuntu Cluster Hosted by VirtualBox

Posted in Big Data, Cloud Computing, Cluster, Java, Linux, Mac OS X, Networking, Open Source, Software Engineering, Software Market Demands | Leave a comment

Running Elasticsearch on a Virtualbox Cluster

Posted in Big Data, Cloud Computing, Cluster, Java, Linux, Mac OS X, Networking, Open Source, Software Engineering, Software Market Demands, Web | Leave a comment

An Introduction to Apache Spark

I’ve prepared a short presentation on Apache Spark. I presented it yesterday morning. Just wanted to share it here as well.

Posted in Big Data, Cloud Computing, Cluster, Java, Linux, Machine Learning, Networking, Open Source, Software Engineering, Software Market Demands | Leave a comment

Trying Big-Data frameworks on your PC

As the first part of a 4 sessions workshop on distributed data processing, I will be speaking about setting up a Linux cluster on your PC.   Distributed Data Processing Workshop – SBU from Amir Sedighi

Posted in Big Data, Cloud Computing, Cluster, Java, Linux, Mac OS X, Networking, Software Engineering, Software Market Demands | 1 Comment

An Introduction to Elasticsearch

I just prepared a presentation on Elasticsearch.

Posted in Big Data, Java, Linux, Mac OS X, Open Source, Software Engineering, Web | Leave a comment

Elasticsearch Daily Indexing On Old Fashion Spinning Disks

I believe that, if it takes long, something is wrong. Regarding this minimalistic approach I’ve resolved something for one of my clients recently. There was a single node with an Elasticsearch instance running on. I had to keep it as … Continue reading

Posted in Big Data, Cloud Computing, Cluster, Java, Linux, Mac OS X, Networking, Open Source, Software Engineering, Software Market Demands | 4 Comments

Manually Scaling Ubuntu Cluster Out

I am not sure. May be this is the fastest native way for adding new node to the clusters of Hadoop, Redis or Elasticsearch or this kind of stuffs. I’ve tested it within a few number of clusters hosted in … Continue reading

Posted in Big Data, Cluster, Linux, Networking, Software Engineering | 1 Comment

Software is Capturing Us

Seems things in the Software Development business are really getting easy ever. Sometimes minor modifications make major improvements. Today Software Development contains a bunch of pretty interesting languages, frameworks and tools. Human had never ever a toy set like this. … Continue reading

Posted in Big Data, Linux, Mac OS X, Machine Learning, Open Source, Software Engineering, Software Market Demands, Web | Leave a comment

A Simple Spring Boot REST Wrapper over Hadoop and Hive

Running REST services in the Java world as much easy as Linux commands, has became possible by Spring Boot. I am making a data warehouse based on hadoop, sqoop, hive, hbase and a number of other big-data giants. It supposed … Continue reading

Posted in Big Data, Java, Linux, Mac OS X, Open Source, Software Engineering, Web | Leave a comment