What Is Microsoft Marketplace
DataMarket?
Michael Stiefel www.reliablesoftware.com
development@reliablesoftware.com
www.reliablesoftware.com/dasblog/default.asp
x
Level: Intermediate

A marketplace of data sets with a standard API.

DataMarket is about the possibilities…

Application: Should I Move There?
Is it safe?
Crime Data from the U. S. Government
What are my neighbors like?
Consumer Expenditure Data
Key US Demographics by Zip Code, Place and County
What is the weather like?
Weather Data
Can I buy a house there?
Home Valuation
Mortgage Information

Trusted Data Providers
Authoritative
Commercial
Government
Structured and Unstructured Data

Uses OData Protocol
REST based OData feed use HTTP/HTTPS URIs.
Open Data Protocol
Astoria / ADO.NET Data Services / WCF Data Services
Builds on ATOM, JSON, XML
Clients can be Java, .NET, PHP, Silverlight, iPhone, Windows Phone 7, etc.

OData Data Model
OData Feed is a collection of typed Entries http://services.odata.org/OData/OData.svc/Products
Entry has simple or complex properties
Service Operations can be exposed http://services.odata.org/OData/OData.svc/
Metadata available http://services.odata.org/OData/OData.svc/$metadata
Allows for automated discovery of different feeds

Types of Queries
Flexible Query
Dynamically Build Queries
Use Visual Studio Add Service Reference
Fixed Query
Predetermined provider query
May or may not have optional parameters
Use provider created proxy class

Making a Query
Formulate Query String
Add parameters for filters, pagination
Server based filtering
Get back XML payload
Authenticate with Account Key

DataMarket Portal…..

Demos

Business Model
Some Free Data Sets for Developers
Transaction (query) or Subscription Pricing
Broad Spectrum of data
"Easy to understand licensing“
Microsoft takes a brokerage commission

Content Developer Opportunities
One place to look for data
One format for getting data
Understand data set through Explorer
Clear licensing
Clear Subscription Model

Subscription Models
Options
Unlimited
Limited to a fixed number of transactions
Billed monthly
Optional throttling by content provider
Auto renew
Free public data sets available

Content Provider Opportunity
Marketplace
Control data, terms, price
Single point of billing
Periodically receive payments and reports
Data transformation to common formats
Long Tail for Data providers
Built on Windows Azure

Advantages
Developer has one billing relationship through the marketplace
Access data sets that were previously difficult to obtain
Standard API allows DataMarket to be used from
Java, PHP, or on an IPhone.

DataMarket Front End Architecture
Azure Web role for portal and requests
Frequent requests cached
In memory cache for VM
Azure tables for distributed cache
Data sources help define cache lifetimes

DataMarket Bank End Architecture
Queues and Worker roles for returning data
SQL Azure for account information
Data sets with CSDL mapping
SQL Azure
Provider Web services
Health Monitoring with sample queries
Transferred to Azure tables with reporting
Alerts based on results
Certificates for 3 rd party connection info

Summary
Dallas is an application built on Azure
Uses OData API for simplicity
Can integrate with Access Control Service
Business Model drives "sense" of the application