Zillabyte View website

Zillabyte Gives Small Developers a Leg-Up in Big Data Analysis Game

Developer description

Applications that analyze big data are used in academia to do everything from understand why ... More

Editor's review

Published 25 Sep 2014

The chase to harness big data has become one of the next great aspirations both in the public and private sectors. But what’s more amazing than the fact that the data we’ve created online over the past two years eclipses the prior record of human civilization, is that now we have methods to capture, analyze and use it, according to Weatherhead University Professor Gary King in an article published by Harvard Magazine.

 

Applications that analyze big data are used in academia to do everything from understand why people change their political beliefs to mapping the human genome, and in the private sector to recommend what Netflix film you should watch or who you should befriend on LinkedIn. For all its potential implications, though, data analytics remains prohibitively complicated and expensive for most organizations to take full advantage of. According to The Wall Street Journal, large corporations are offering data scientists with minimal experience $200,000 to $300,000 starting salary. And, until recently, big data has been mostly tackled by big business.

 

However, smaller developers recently got a leg up in the big data analysis game with the re-launch of Zillabyte, a cloud platform for data analysis.

 

Zillabyte allows developers to concentrate on building their data analysis app instead of worrying about the infrastructure for large-scale and distributed app analysis.

 

“Our technology does the legwork to make distributed computing accessible and affordable for businesses with big vision and an intelligent budget,” says co-founder Jake Quist.

 

Zillabyte takes care of things like data acquisition, algorithm implementation, and resource management, so that users don’t have to. A pre-programmed bloc of datasets includes a crawled copy of the Internet – over 55 million URLs – allowing users to focus on honing inquiries rather than programming functions, and users can analyze their personal data sets as well.

 

In addition, Zillabyte has a bank of data mining algorithms at users’ disposal to build on other users’ contributions to geocoding, web scraping and fraud analysis, among many others.

 

“We’ve put a lot of time in making our scripting language approachable by anyone who knows Ruby, Python, or JavaScript,” says Quist. “We put in all the frustrating backend work so that businesses are left with a crisp, intuitive experience with all of the functionality they could possibly want and none of the headache.”

 

The possibilities are endless. With a platform that provides ‘distributed computing on demand,’ and an open platform that translates high-powered algorithms into intelligible tools, Zillabyte is poised to change the way we look at data.

 

“Users only pay for the resources they consume,” says Quist. “But the offering is in fact much ampler than that. You’re getting all the data and high-end apps we’ve already integrated into the platform, but more importantly, you’re getting the ability to make your own searches and build your own algorithms. We’ve opened our coding language so businesses can build functions against the platform, because we believe that Zillabyte is a vehicle for empowerment.”

 

How it works

 

– Developer creates an app in his/her preferred coding language (platform currently supports Ruby, Python and JavaScript)

 

– Developer tests the code locally using the Zillabyte test command

 

– Developer pushes app to Zillabyte, where Zillabyte executes app to scale


– Upon completion, Developer will download the output data of the app


By Jim Glade

 

By using our website, you agree to our privacy policy   OK