I often use data from various sources and sometimes have to get creative about transforming the data into a format that I can use easily. So far I have done this mainly with R (and with Python from time to time). The other day, Dr. Mazzolla pointed to OpenRefine, an application for data clean-up and…
When I teach R, I always caution the audiences about the quirks of R programming. It is very typical for someone with a background in Java or Python to write code in R that will take forever to execute (like I used to do, and sometimes still do). I warn the students about loops and…
I will be presenting our paper, “Surviving and Thriving in Online Labor Markets” this weekend at WISE 2015. Our study aims to uncover the dynamics shaping the online labor markets (freelancer.com, upwork.com, elance.com …), with a focus on the role of country development level on the IT service providers’ ability to survive and earn a…
Google open sourced TensorFlow (TF), a distributed machine learning library, in November. The basic idea is that, you build your ML process into a graph and let TF handle the running and distribution of the work between cores. Be it cores in your CPU or GPU, TF has you covered. The dataflow graph works much…
I am currently developing a tutorial for EMBA students for IBM’s Watson Explorer. Having just recently finished content development for R workshop for MSBA, I must say it is a pretty interesting experience. On the one hand you have R, a complex but powerful tool that is designed to lift (almost) any kind of analytics…
I have been working on the upcoming R workshop for a few weeks now. Finally I am ready to publish part of the material in the spirit of open source, so that others can benefit from, and improve upon my material. I uploaded all the materials to my github repository. There are a few documents…
I am preparing presentations for the upcoming R workshop. That means I have to find a way to integrate R code and results into my presentations. Now I know there are a number of ways to achieve this, but I like beamer for presentations and R for analysis. Now thanks to Knitr, I can bring…
I am working on a workshop for Business Analytics masters students. Part of the demos I intend to use are geographical visualizations. I am using rworldmap package to achieve these. Let us say you have geographical data in a data.frame such as country, with country identifiers stored in “ip_iso2” column in ISO2 format and the…
EDIT: I CHANGED THE SERVICE PROVIDER FOR THE BLOG AND THE CODE BLOCK BELOW GOT MESSED UP. ALL SLASHES WERE GONE. I TRIED TO FIX IT MANUALLY. BEWARE I did my proposal yesterday and it went well 😀 I used beamer to prepare my slide deck and was very pleased with how easy it was…
I was pleasantly surprised to find out that Arizona State University was a member of AWS educate, more so since my year of free trial ran out last month and I just payed my first bill for the Amazon instance I use for data collection. Amazon Web Services provides an easy to deploy, easy to…
I use markdown in my analysis reports and for my research log. When I was thinking of putting up a more official looking public profile page, I found myself thinking of using markdown to create my profile page on ASU web site. While Markdown is convenient in generating HTML, it is not really suited for…
PLM package is pretty decent for traditional econometric models, yet when it comes to datasets I have to deal with everyday it can be pretty inefficient. If only we had a version of within transformation that would work with multiple clustering variables… Actually, we have it in the form of felm package for R from…
For one of my projects I am using Python scripts to scrape web pages. Unfortunately, the dates in the pages are not in a consistent format. Some are like Jun 19 2014, whereas others are 28-Mar-14, yet others are 2010-Sep-20. The trickiest ones are the ones like Jun-10. Thanks to plannapus in stack overflow I…
I have been using Linux as my main system for years. One thing I have always felt the lack of was the Word’s grammar checking facilities. Especially when writing in LaTeX, I have often felt the lack of an automated system to catch the most common errors. Thanks to John Horton from MIT, now we…
Today I was faced with an interesting challenge, finding time zones for users defined by latitude and longitude. Thanks to extensive package libraries of R, the solution was not hard at all.
I am not much of a SAS person, I feel more comfortable in R. Yet there is one area where I feel SAS excels: experimental design, especially discrete choice experiments. Now to be honest, Aizaki 2012, also presents some basic guidelines in choice experiment design but the macros are nowhere near as elegant or as…
Theorizing that Newton’s theory of gravity holds for IT, and testing it by dropping a PC from an office window in the MIS department is obviously not valuable. March and Smith, 1995
From time to time I need to use SAS for some piece of analysis. Unfortunately installing SAS requires some workarounds these days. Here is my note to self on trickier parts of SAS installation. 1- Switch to bash instead of dash 2- Install dependencies
I use Wireshark in my demonstrations for the CIS-430 Networking and Distributed Systems class. I always enjoy the reaction of students when I sniff their FTP passwords off the air. To be able to gather packets in promiscuous mode how ever requires some authorization changes. Here is how I did it the last time I…
Through our discussions with the PhD students in the department, the lack of a replication journal has always been something we felt the lack of. Everybody agreed that scientific progress required replicability of results but, no one was able to spare the time to an endeavour which would surely go unrewarded. Now that there is…
I respect your privacy. No cookies are used to track you.
Manage your cookie preferences below:
Essential cookies enable basic functions and are necessary for the proper function of the website.
These cookies are needed for adding comments on this website.
You can find more information in my Cookie Policy and Privacy Policy. Essentially, I don't track you, I don't collect information on you beyond the most basic (what pages you read) and I never ever sell your data. This isn't a for profit operation.
