U2U Blog

for developers and other creative minds

Loading data in Azure Machine Learning

In July 2014 Microsoft made their cloud-based data mining environment (known as Azure Machine Learning, or AzureML) available to the public. With this platform users can analyze large amounts of data without the need to install and configure special software: A browser and a credit card is all you need Glimlach. With the increasing number of people in a number-crunching job (data scientists) it is nice to see Microsoft focusing on this.

In a previous blog post (see http://blogs.u2u.be/u2u/post/2014/07/14/First-Steps-in-Azure-Machine-Learning.aspx) I show how to get started with setting up an AzureML environment. In this blog post we take a look at loading data in AzureML.

Supported data formats

Currently AzureML is focusing on the most common formats used in the world of machine learning:

  • Text files containing comma separated values (CSV), tab-separated values (TSV), the Attribute-Relation File Format (ARFF) which was introduced by the open-source Weka machine learning framework, RData files or the SVMLight format.
  • Database tables: Hive tables (Hadoop), Azure Tables and SQL Databases in Azure

Since AzureML runs in the Azure cloud, all your data must be in the cloud as well. Either you already uploaded your data to Azure (e.g. your data is stored in an Azure SQL Database) or you will upload it explicitly for this project. In both cases be careful to store your data in the same region as where you’re running your AzureML, since in the preview period, AzureML only runs from the South Central US data center. If you store your data in another data center it will be slower and more expensive to run your experiments.

Let’s first consider the scenario where you upload your data from a local file directly into AzureML (Uploading a DataSet), then we cover the scenario where your data is already somewhere in Azure (Reading data).

Uploading a DataSet

A lot of sample machine learning data sets are already available out-of-the-box in Azure ML. But after some experimenting with public data, you probably want to play with your own data. If you didn’t have your data anywhere on Azure yet, you can upload it as a new dataset in AzureML directly. But before we start adding data sets, first a warning: In the current preview we cannot delete uploaded datatsets. We can override an existing data set with new data, but if you create 1001 data sets, they will be in the list forever (that is: until Microsoft fixes this limitation). Because of this, if your dataset is not yet fixed, consider uploading the data file(s) into a custom Azure blob store and then load them with the reader from within your experiment.

To add a new dataset, click the +New button at the bottom left of the ML Studio screen, and select DataSet –> From local file. In the next dialog box, we can pick the file to upload, provide a name (choose well, it cannot be altered later on), select the type of data in the file and provide an optional description:
image

If you select the checkbox you select an existing dataset, who’s content will be overwritten by the file you select. It is impossible to delete or rename a datset, but you can always upload an empty file ‘as a new version’ of a large data set to truncate it.

If we now want to use this data, we create a new experiment by clicking the +New button. In this new experiment under the Saved Datasets we will find our uploaded dataset among the list. Just drag it to the design surface.

image

Also remember the search box at the top: by typing part of an object name (and a data set is one of the many objects we have in AzureML) we get a filtered list which makes it easier to find an object.

Now that we have our data in AzureML we can start interacting with it, such as simply visualizing our data: click in the circle under the data set and select Visualize:
image

This will open up the overview screen, showing basic statistical information on each data field:

image

Reading data

Another way to get data in an AzureML experiment is by first uploading your data in a Azure SQL Database, an Hadoop cluster (such as HDInsight) or upload the files with data (same data types as we had in the previous paragraph) into an Azure blob store.

In this case you do not need to create a data set, but you can immediately create a new experiment.

In this experiment, locate the Reader under Data Input and Output and drag it into the experiment.
image
When we click in the Reader, we get on the right-hand side all the configurable properties of this Reader. The most important property is the data source type. This one determines which other properties are needed. Select over here the location where your data can be found and configure the other properties appropriately
image

When we now run the experiment, we can visualize the data from this reader, just as we could we an uploaded data set. But we have an extra option. By clicking Save as dataset, we can permanently store this data in AzureML. This speeds up the runtime of an experiment, but it increases the storage cost (we store another redundant copy of the data).
image

In a next blog post, I will discuss data preprocessing.

Comments (47) -

  • just click the following page

    8/5/2014 1:50:19 PM |

    Howdy very cool site!! Man .. Excellent .. Wonderful .. I'll bookmark your web site and take the feeds also¡KI am glad to search out numerous useful info here within the post, we want work out extra strategies on this regard, thanks for sharing. . . . . .

  • Kelly B. Polanco

    8/6/2014 11:57:07 AM |

    It’s very simple to find out any matter on net as compared to textbooks, as I found this article at this web site.

  • real racing 3 cheats

    8/7/2014 8:47:34 PM |

    Hi! I've been following your weblog for a while now and finally got the bravery to go ahead and give you a shout out from  Kingwood Texas! Just wanted to tell you keep up the good work!

  • DEBORA Laurence

    8/11/2014 9:24:15 AM |

    ELIHES,Transport de voyageur & vtc elihes.com/, Chauffeur privé sur paris et région parisienne.

  • DEBORA Laurence

    8/11/2014 8:40:08 PM |

    annuaires-gratuit.com/ vous propose de créer gratuitement un annuaire de sites internet pour un bon référencement.

  • DEBORA Laurence

    8/11/2014 9:53:21 PM |

    annuaires-gratuit.com/ vous propose de créer gratuitement un annuaire de sites internet pour un bon référencement.

  • Pizza Delivery Software

    9/12/2014 12:46:51 AM |

    I knew a new thing. thanks for sharing

  • DEBORA Laurence

    9/17/2014 12:28:10 PM |

    Covoiturage, annonce & covoiturage. Deposer votre annonce gratuitement sur portail2000.com/ et faites des rencontres

  • interior

    9/18/2014 3:15:10 PM |

    Nice blog and attracting colors!

  • Bert Timi

    9/21/2014 10:31:10 AM |

    Good work Smile cheers!

  • Bryan Tousom

    9/23/2014 7:48:02 PM |

    Havin that much written content do you somehow have any issues of copyright infringement? My website has lots of exclusive content I've either created myself or outsourced but it appears a lot of it is popping it up all over the internet without my agreement. Do you know any ways to help prevent content from being ripped off? I'd really appreciate it.

  • Joe Bartlette

    9/24/2014 3:24:08 AM |

    It’s arduous to search out knowledgeable folks on this subject, but you sound like you realize what you’re speaking about! Thanks

  • Greg Sabel

    9/25/2014 7:58:46 AM |

    What i don't understood is actually how you're not really much more well-liked than you might be right now. You're very intelligent. You realize thus significantly relating to this subject, made me personally consider it from numerous varied angles. Its like women and men aren't fascinated unless it is one thing to do with Lady gaga! Your own stuffs nice. Always maintain it up!

  • Jeri Hermenegildo

    10/5/2014 7:42:40 PM |

    <a href="http://www.bizprof.sg";> accounting outsource services</a>, you can check this out too.

  • vp-corp

    10/6/2014 5:44:03 PM |

    Great post Thank yous for sharing,

  • Shayne Gunn

    10/9/2014 1:06:57 AM |

    </a> we will alwys be in a dilema to find the best and afffordable rate for hostel in singapore with the increasing cost in singapore.

  • Kathrine Apthorpe

    10/13/2014 2:07:19 PM |

    Howdy, i read your blog occasionally and i own a similar one and i was just wondering if you get a lot of spam comments? If so how do you prevent it, any plugin or anything you can advise? I get so much lately it's driving me mad so any assistance is very much appreciated.

  • click here

    10/16/2014 8:32:09 AM |

    Incredibly, it's just a marvelous amount of write down which I have discover through for a long time very long. Actually do aside from that examine my personal online business.

  • please click %url_domain%

    10/16/2014 7:45:34 PM |

    I want to express my appreciation to the writer just for bailing me out of this type of setting. After looking through the world wide web and getting views that were not beneficial, I assumed my entire life was well over. Existing without the presence of solutions to the difficulties you have solved all through your entire write-up is a crucial case, and ones that might have negatively damaged my entire career if I hadn't come across your blog. Your own personal mastery and kindness in dealing with all areas was tremendous. I don't know what I would've done if I had not discovered such a step like this. I can now look forward to my future. Thanks for your time very much for this reliable and results-oriented help. I will not hesitate to refer your web site to anyone who requires assistance about this issue.

  • hogan outlet

    10/26/2014 5:51:28 PM |

    Kia enjoy presented their valuable top of the line version into the Veteran Ceed spectrum by some definitely luring transient Tv for pc proving. A clever and in addition spontaneous <a href="http://www.nadirstar.com/libraries/";>hogan online</a> answer to results their own purposes associated with releasing easily affordable competitive sports coupe decorating in a Western clients.

  • hogan rebel

    10/29/2014 11:03:53 PM |

    Kia enjoy introduced their personal most current version within the Specialist Ceed series with terribly inviting brief Telly promotion. A brilliant plus easy-to-use <a href="http://www.nadirstar.com/libraries/";>hogan uomo 2014</a> method hit most of their usages in proposing budget-friendly physical activities coupe design and style up to a Euro customers.

  • scarpe hogan

    10/30/2014 4:42:06 PM |

    Frd need presented their most popular copy inside the Instructor Ceed spread with just a few seriously tempting fast Shows online marketing. A good and as a result intuitive <a href="http://www.nadirstar.com/libraries/";>hogan interactive</a> system to benefit a person's intentions involving promising cheap games coupe hairstyling onto a European union readership.

  • interior

    10/30/2014 4:50:53 PM |

    Interior Design Malaysia B and N Design Associate

  • hogan outlet

    10/31/2014 9:16:18 PM |

    Toyota experience discharged his / her most recent variant in the Skilled Ceed quantity by seriously seductive simple Tv programs marketing. An inspired and even natural <a href="http://www.nadirstar.com/libraries/";>scarpe hogan on line</a> solution outcome her plans with regards to releasing reasonably-priced running coupe styling towards European fans.

  • Ahmed Ultsch

    10/31/2014 10:29:53 PM |

    I really enjoy the article post.Much thanks again. Really Cool.

  • hogan outlet

    11/1/2014 7:49:56 PM |

    Kia hold created ones own most popular kind for the Executive Ceed wide variety which includes very persuading speedy Television for computer internet marketing. A creative and consequently spontaneous <a href="http://www.nadirstar.com/libraries/";>hogan online</a> approach to benefit his or her aims on handing out highly affordable competitive sports car straightening at a Western projected audience.

  • DEBORA Laurence

    11/4/2014 11:32:15 AM |

    Covoiturage, annonce & covoiturage. Deposer votre annonce gratuitement sur portail2000.com/ et faites des rencontres

  • see post

    11/6/2014 12:50:44 PM |

    I just want to tell you that I am just very new to blogging and really enjoyed this web-site. More than likely I’m going to bookmark your website . You amazingly come with remarkable writings. Kudos for revealing your web site.

  • DEBORA Laurence

    11/12/2014 2:35:49 AM |

    Forum Annuaires-gratuit.com, annuaire de sites web et moteur de recherche sur annuaires-gratuit.com/annuaires/ .

  • DEBORA Laurence

    11/12/2014 2:51:50 AM |

    Forum Annuaires-gratuit.com, annuaire de sites web et moteur de recherche sur annuaires-gratuit.com/annuaires/ .

  • DEBORA Laurence

    11/12/2014 3:14:39 AM |

    Forum Annuaires-gratuit.com, annuaire de sites web et moteur de recherche sur annuaires-gratuit.com/annuaires/ .

  • DEBORA Laurence

    11/12/2014 3:15:05 AM |

    Forum Annuaires-gratuit.com, annuaire de sites web et moteur de recherche sur annuaires-gratuit.com/annuaires/ .

  • DEBORA Laurence

    11/12/2014 3:58:44 AM |

    Forum Annuaires-gratuit.com, annuaire de sites web et moteur de recherche sur annuaires-gratuit.com/annuaires/ .

  • DEBORA Laurence

    11/12/2014 4:15:34 AM |

    Forum Annuaires-gratuit.com, annuaire de sites web et moteur de recherche sur annuaires-gratuit.com/annuaires/ .

  • DEBORA Laurence

    11/12/2014 4:17:51 AM |

    Forum Annuaires-gratuit.com, annuaire de sites web et moteur de recherche sur annuaires-gratuit.com/annuaires/ .

  • DEBORA Laurence

    11/12/2014 6:32:19 AM |

    Forum Annuaires-gratuit.com, annuaire de sites web et moteur de recherche sur annuaires-gratuit.com/annuaires/ .

  • DEBORA Laurence

    11/12/2014 7:01:33 AM |

    Forum Annuaires-gratuit.com, annuaire de sites web et moteur de recherche sur annuaires-gratuit.com/annuaires/ .

  • DEBORA Laurence

    11/12/2014 11:43:44 AM |

    Forum Annuaires-gratuit.com, annuaire de sites web et moteur de recherche sur annuaires-gratuit.com/annuaires/ .

  • DEBORA Laurence

    11/12/2014 11:50:05 AM |

    Forum Annuaires-gratuit.com, annuaire de sites web et moteur de recherche sur annuaires-gratuit.com/annuaires/ .

  • DEBORA Laurence

    11/12/2014 12:14:09 PM |

    Forum Annuaires-gratuit.com, annuaire de sites web et moteur de recherche sur annuaires-gratuit.com/annuaires/ .

  • DEBORA Laurence

    11/12/2014 12:19:47 PM |

    Forum Annuaires-gratuit.com, annuaire de sites web et moteur de recherche sur annuaires-gratuit.com/annuaires/ .

  • DEBORA Laurence

    11/12/2014 12:34:40 PM |

    Forum Annuaires-gratuit.com, annuaire de sites web et moteur de recherche sur annuaires-gratuit.com/annuaires/ .

  • DEBORA Laurence

    11/12/2014 12:59:43 PM |

    Forum Annuaires-gratuit.com, annuaire de sites web et moteur de recherche sur annuaires-gratuit.com/annuaires/ .

  • DEBORA Laurence

    11/12/2014 1:15:09 PM |

    Forum Annuaires-gratuit.com, annuaire de sites web et moteur de recherche sur annuaires-gratuit.com/annuaires/ .

  • DEBORA Laurence

    11/12/2014 1:18:42 PM |

    Forum Annuaires-gratuit.com, annuaire de sites web et moteur de recherche sur annuaires-gratuit.com/annuaires/ .

  • DEBORA Laurence

    11/12/2014 2:05:38 PM |

    Forum Annuaires-gratuit.com, annuaire de sites web et moteur de recherche sur annuaires-gratuit.com/annuaires/ .

  • DEBORA Laurence

    11/12/2014 2:06:05 PM |

    Forum Annuaires-gratuit.com, annuaire de sites web et moteur de recherche sur annuaires-gratuit.com/annuaires/ .

  • DEBORA Laurence

    11/12/2014 2:14:12 PM |

    Forum Annuaires-gratuit.com, annuaire de sites web et moteur de recherche sur annuaires-gratuit.com/annuaires/ .

  • how to make ice cream without a machine

    11/27/2014 8:25:42 PM |

    Wow, marvelous weblog layout! How lengthy have you been blogging for? you made blogging glance easy. The overall look of your website is fantastic, as well as the content!

  • homemade ice cream recipes

    12/7/2014 1:02:19 AM |

    Keep functioning ,remarkable job!

  • Ryan Rehman

    12/7/2014 9:31:43 AM |

    Sweet website , super layout, real clean and utilise genial.

  • Clarence Gatta

    12/7/2014 10:59:57 AM |

    I like this weblog very much, Its a really nice post to read and receive info .

  • idlife

    12/8/2014 7:00:44 AM |

    Nice post! Check out my site sometime!

  • idlife

    12/8/2014 7:16:26 AM |

    Nice post! Check out my site sometime!

  • idlife

    12/8/2014 10:44:12 AM |

    Nice post! Check out my site sometime!

  • making ice cream

    12/11/2014 1:58:46 AM |

    I really appreciate this post. I¡¦ve been looking all over for this! Thank goodness I found it on Bing. You have made my day! Thank you again

  • how to make ice cream out of snow

    12/11/2014 2:47:09 AM |

    Its like you read my mind! You appear to know a lot about this, like you wrote the book in it or something. I think that you can do with some pics to drive the message home a bit, but instead of that, this is wonderful blog. A great read. I'll definitely be back.

  • making ice cream

    12/11/2014 7:47:02 AM |

    Well I sincerely liked studying it. This tip offered by you is very helpful for good planning.

  • ice cream maker reviews

    12/11/2014 11:11:15 AM |

    Great tremendous things here. I'm very glad to look your article. Thank you so much and i am taking a look ahead to contact you. Will you please drop me a mail?

  • Tyson F. Gautreaux

    12/13/2014 7:04:43 AM |

    También es cierto de la escuela de medicina, facultad de derecho, y las academias militares. Pero rango en la clase no le dice todo sobre el estudiante.

  • Lacey Gilliss

    12/13/2014 7:19:55 PM |

    Recibió la tarjeta postal de Travelocity, llamada al número dado y por supuesto, no conseguí nada de ellos en la escritura. Hice una búsqueda en Internet y encontré este sitio. Es claramente una estafa. Por lo menos, son "phishing" para obtener información personal. A lo sumo, está obteniendo fraudulentamente dinero para un servicio o producto que no proporcionan. No entiendo por qué estas operaciones pueden desactivarse más rápidamente de lo que son.  < br / &gt;

  • fishinglovers

    12/14/2014 3:10:16 AM |

    I am so grateful for your article post.Really thank you! Fantastic.

  • Mental Health Social Network

    12/14/2014 5:56:53 PM |

    Hello, nice post!

  • Chau Downard

    12/14/2014 9:10:08 PM |

    Así que decir los clientes a la derecha?

  • Mental Health Social Network

    12/14/2014 11:01:59 PM |

    Hello, nice post!

  • Mental Health Social Network

    12/15/2014 4:18:09 AM |

    Hello, nice post!

  • fishinglovers

    12/17/2014 12:42:41 PM |

    Thanks again for the blog article.Really thank you! Cool.

  • fishinglovers

    12/18/2014 2:58:04 AM |

    Fantastic blog.Really looking forward to read more. Will read on...

  • Arden Schwartzwalde

    12/19/2014 4:22:37 PM |

    Between me and my husband we've owned more MP3 players over the years than I can count, including Sansas, iRivers, iPods (classic & touch), the Ibiza Rhapsody, etc. But, the last few years I've settled down to one line of players. Why? Because I was happy to discover how well-designed and fun to use the underappreciated (and widely mocked) Zunes are.

  • Winford Seabaugh

    12/19/2014 4:28:11 PM |

    I'll gear this review to 2 types of people: current Zune owners who are considering an upgrade, and people trying to decide between a Zune and an iPod. (There are other players worth considering out there, like the Sony Walkman X, but I hope this gives you enough info to make an informed decision of the Zune vs players other than the iPod line as well.)

  • Gregorio Cadoff

    12/19/2014 4:36:00 PM |

    The new Zune browser is surprisingly good, but not as good as the iPod's. It works well, but isn't as fast as Safari, and has a clunkier interface. If you occasionally plan on using the web browser that's not an issue, but if you're planning to browse the web alot from your PMP then the iPod's larger screen and better browser may be important.

  • Milford Lubke

    12/19/2014 4:36:16 PM |

    This is getting a bit more subjective, but I much prefer the Zune Marketplace. The interface is colorful, has more flair, and some cool features like 'Mixview' that let you quickly see related albums, songs, or other users related to what you're listening to. Clicking on one of those will center on that item, and another set of "neighbors" will come into view, allowing you to navigate around exploring by similar artists, songs, or users. Speaking of users, the Zune "Social" is also great fun, letting you find others with shared tastes and becoming friends with them. You then can listen to a playlist created based on an amalgamation of what all your friends are listening to, which is also enjoyable. Those concerned with privacy will be relieved to know you can prevent the public from seeing your personal listening habits if you so choose.

  • Humberto Scobie

    12/19/2014 4:38:57 PM |

    Hands down, Apple's app store wins by a mile. It's a huge selection of all sorts of apps vs a rather sad selection of a handful for Zune. Microsoft has plans, especially in the realm of games, but I'm not sure I'd want to bet on the future if this aspect is important to you. The iPod is a much better choice in that case.

  • Margarette Coontz

    12/19/2014 4:42:33 PM |

    Between me and my husband we've owned more MP3 players over the years than I can count, including Sansas, iRivers, iPods (classic & touch), the Ibiza Rhapsody, etc. But, the last few years I've settled down to one line of players. Why? Because I was happy to discover how well-designed and fun to use the underappreciated (and widely mocked) Zunes are.

  • Michal Sucre

    12/19/2014 7:37:50 PM |

    EB sólo debe cobran por mensaje de texto (sería mínimo) si el envío / recepción no es parte de su plan de datos. Sólo asegúrese de darse de baja. Reportar este comentario

  • ernaehrungsumstellung im focus

    12/20/2014 4:58:47 PM |

    Oh my goodness! Impressive article dude! Many thanks, However I am experiencing issues with your RSS. I don’t understand why I am unable to join it. Is there anybody else having identical RSS issues? Anyone who knows the answer will you kindly respond? Thanx!!

  • ernaehrungsumstellung im focus

    12/20/2014 5:04:43 PM |

    Very good post. I definitely appreciate this website. Keep it up!

  • interior

    12/21/2014 2:08:40 PM |

    REVE design Inc. is one of the interior design companies in Los Angeles California. The company caters to residential commercial retail restaurant and

  • Andrew Pelt

    12/21/2014 2:47:13 PM |

    Way cool! Some very valid points! I appreciate you penning this write-up plus the rest of the website is really good.

  • Andrew Pelt

    12/21/2014 5:40:33 PM |

    You need to be a part of a contest for one of the highest quality sites on the web. I am going to recommend this website!

  • Camilo Concha

    12/21/2014 6:20:59 PM |

    I have to thank you for the efforts you've put in penning this blog. I am hoping to check out the same high-grade content from you later on as well. In fact, your creative writing abilities has encouraged me to get my own, personal blog now ;)

  • Matthew C. Kriner

    12/21/2014 7:22:19 PM |

    It’s nearly impossible to find well-informed people on this subject, but you sound like you know what you’re talking about! Thanks

  • Camilo Concha

    12/21/2014 9:31:37 PM |

    There's definately a lot to know about this issue. I like all of the points you've made.

  • Camilo Concha

    12/21/2014 9:36:05 PM |

    Good post. I learn something new and challenging on sites I stumbleupon every day. It's always interesting to read content from other writers and practice something from their sites.

Loading