Thursday, July 21, 2005
Open Data
I recently read Scott White's (et al) discussions on Open Data and the Implications of Data Disownership and although I may not have caught the entire jist, it came to my attention yesterday during some discussions with a company i was talk with.
You see the positive thing (in this case) is that it is a government body. They don't make money opening the system via web services, but it helps third parties integrate and use their services. I suddenly started to see not only the open services that could be made available, but the data resuse that makes no sense to be duplicated everywhere.
We have NI numbers, company addresses, people addresses, qualifications and so on that are really just sematic data on top of the core functions of the system (they are each managed by a separate larger body), which is really about payments. So i think - why do we store and manage all of this stuff. I can say that most of the effort is around managing stuff they only need to know about and shouldn't really have to maintain. A company registration number can be used to tell us everything we need to know about a company, so why manage and store the entire company details. This extends to the other attributes. Opening the services would be great, but there is a snag.
You see they all want to open their systems, but charge to get to the data. Not only that, but the drive of services will see others use your service within their services - this is exactly a case we have just now. We provide an address lookup facility which is managed by a third party. However, the data itself is owned by the post office and the third party license that from them! So if we serve this data out of our own service then although the software people may be happy to open the API, the Post Office aren't going to be happy their data is floating around the web with a single license paying for it!!
The net result is duplication. And this extends to the other attributes and no doubt around the web there are many cases of this. So you get to a point where services can only DO things and the things you get become hazy. Or rather, what you can DO with what you get back is hazy - "Yep, I found 6 matches which may be the address they are looking for based on their query, but the license tells me i can't send it back to them."
In the enteprise I don't see an easy way out of this short term. However, if profiles were available direclty from the source (e.g. the person, the company and so on - ignore verification of that for just now), then maybe certain links in the chain could be ignored and we would be in a position where Open Data could be a reality.
You see the positive thing (in this case) is that it is a government body. They don't make money opening the system via web services, but it helps third parties integrate and use their services. I suddenly started to see not only the open services that could be made available, but the data resuse that makes no sense to be duplicated everywhere.
We have NI numbers, company addresses, people addresses, qualifications and so on that are really just sematic data on top of the core functions of the system (they are each managed by a separate larger body), which is really about payments. So i think - why do we store and manage all of this stuff. I can say that most of the effort is around managing stuff they only need to know about and shouldn't really have to maintain. A company registration number can be used to tell us everything we need to know about a company, so why manage and store the entire company details. This extends to the other attributes. Opening the services would be great, but there is a snag.
You see they all want to open their systems, but charge to get to the data. Not only that, but the drive of services will see others use your service within their services - this is exactly a case we have just now. We provide an address lookup facility which is managed by a third party. However, the data itself is owned by the post office and the third party license that from them! So if we serve this data out of our own service then although the software people may be happy to open the API, the Post Office aren't going to be happy their data is floating around the web with a single license paying for it!!
The net result is duplication. And this extends to the other attributes and no doubt around the web there are many cases of this. So you get to a point where services can only DO things and the things you get become hazy. Or rather, what you can DO with what you get back is hazy - "Yep, I found 6 matches which may be the address they are looking for based on their query, but the license tells me i can't send it back to them."
In the enteprise I don't see an easy way out of this short term. However, if profiles were available direclty from the source (e.g. the person, the company and so on - ignore verification of that for just now), then maybe certain links in the chain could be ignored and we would be in a position where Open Data could be a reality.
http://stevenR2.com
... a brief history
Site XML Feed
www.flickr.com |
Posts By Date
Profiles
- my taghop.org web
- taghop linkblogs
- todo list
- who i know
- flickr photos
- delicious links
- evdb events
- my things
- odeo subscriptions
NeighBloggers
taghop
Also made in Scotland
- Tarmac (John Loudon MacAdam)
- McIntosh Coat (Charles McIntosh)
- James Clerk Maxwell
- David Livingstone
- Television (John Logie Baird)
- BBC (Lord Reith)
- Kelvin Temperatures (William Thomson)
- RADAR (Sir Robert Alexander Watson-Watt)
- Steam Engine (James Watt)
- Americanism (John Witherspoon)
- Telephone (Alexander Graham Bell)
- Penicillin (Sir Alexander Fleming)
- Patron Saint of Ireland (Saint Patrick)
- Charles Rennie Mackintosh
- Celtic FC (Jock Stein)
- Treasure Island (Robert Louis Stevenson)
- Paddle Steamer (William Symington)
- Encylopaedia Britannica (William Smellie)
- Las Palmas Observatory (Charles Piazzi Smyth)
- The Bank of England (William Paterson)
- Logarithms & the Decimal Point (John Napier)
- The World Cup (Sir Thomas Lipton)
- MoreOver.com (David Galbraith)
- Blackboard (James Pillans)
- Liverpool FC (Bill Shankly)
- Iron Plough (James Small)
- Robinson Crusoe (Alexander Selkirk)
- Helium (Sir William Ramsay)
- Sociology (Adam Ferguson)
- Harry Potter
- Landspeed Record (Richard Noble)
- Hot Blast Oven (James Beaumont Neilson)
- Coal-Gas Lighting (William Murdock)
- Prime Minister of Canada (Sir John Alexander MacDonald)
- The Bicycle (Kirkpatrick Macmillan)
- Reflecting Telescope (James Gregory)
- The World's Worst Poet (William Topaz McGonagall)
- Geology (James Hutton)
- Carnegie Mellon (Andrew Carnegie)
- Carnegie Institution (Andrew Carnegie)
- Grandfather of the United States (Robert Dinwiddie)
- Universal Standard Time (Sir Sandford Fleming)
- Latent Heat & Carbon Dioxide (Joseph Black)
- James Bond (Sean Connery)
- Rob Stewart
- Auld Lang Syne (Robert Burns)
- Billy Connolly
- Annie Lennox
- U.S. Navy (John Paul Jones)
- Chariots of Fire (Eric Henry Liddell)
- Cure for Scurvy (James Lind)
- Tea Bags (Sir Thomas Lipton)
- Vacuum flask (Sir James Dewar)
- Postage Stamp (James Chalmers)
- Clerk Cycle Gas Engine (Sir Dugald Clerk)
- Cure for Malaria (George Cleghorn)
- Cure for Malaria (George Cleghorn)
- Groundskeeper Willie
- Peter Pan (Sir James Barrie)
- Kaleidoscope (Sir David Brewster)
- Toronto Globe (George Brown)
- Sherlock Holmes (Sir Arthur Conan Doyle)
- Graham's Law (Thomas Graham)
- The Wind in the Willows (Kenneth Grahame)
Release 2.0
Release 1.0
What I know
I Read
Archives
- July 17, 2005
- July 18, 2005
- July 19, 2005
- July 20, 2005
- July 21, 2005
- July 22, 2005
- July 27, 2005
- July 28, 2005
- August 01, 2005
- August 02, 2005
- August 03, 2005
- August 04, 2005
- August 07, 2005
- August 08, 2005
- August 09, 2005
- August 10, 2005
- August 11, 2005
- August 12, 2005
- August 13, 2005
- August 17, 2005
- August 19, 2005
- August 22, 2005
- August 24, 2005
- August 25, 2005
- August 27, 2005
- August 29, 2005
- August 30, 2005
- September 01, 2005
- September 02, 2005
- September 03, 2005
- September 04, 2005
- September 21, 2005
- September 22, 2005
- September 23, 2005
- September 30, 2005
- October 04, 2005
- October 06, 2005
- October 11, 2005
- October 14, 2005
- October 25, 2005
- October 27, 2005
- November 02, 2005
- November 08, 2005
- November 10, 2005
- November 12, 2005
- November 14, 2005
- November 16, 2005
- November 22, 2005
- December 02, 2005
- December 07, 2005
- December 23, 2005
- December 30, 2005
- January 02, 2006
- January 10, 2006
- January 11, 2006
- January 12, 2006
- January 14, 2006
- January 15, 2006
- January 16, 2006
- January 19, 2006
- January 20, 2006
- January 24, 2006
- January 25, 2006
- January 26, 2006
- January 30, 2006
- February 07, 2006
- February 08, 2006
- February 09, 2006
- February 20, 2006
- February 22, 2006
- February 23, 2006
- February 24, 2006
- February 27, 2006
- February 28, 2006
- March 01, 2006
- March 06, 2006
- March 08, 2006
- March 10, 2006
- March 13, 2006
- March 22, 2006
- March 24, 2006
- March 28, 2006
- March 29, 2006
- March 30, 2006
- March 31, 2006
- April 02, 2006
- April 06, 2006
- April 07, 2006
- April 13, 2006
- April 20, 2006
- April 26, 2006
- April 27, 2006
- April 28, 2006
- April 29, 2006
- April 30, 2006
- May 01, 2006
- May 02, 2006
- May 03, 2006
- May 04, 2006
- May 05, 2006
- May 07, 2006
- May 08, 2006
- May 10, 2006
- May 11, 2006
- May 15, 2006
- May 16, 2006
- June 02, 2006
- June 05, 2006
- June 06, 2006
- June 09, 2006
- June 11, 2006
- June 12, 2006
- June 13, 2006
- June 14, 2006
- June 20, 2006
- June 24, 2006
- June 26, 2006
- June 27, 2006
- June 29, 2006
- June 30, 2006
- July 01, 2006
- July 03, 2006
- July 08, 2006
- July 10, 2006
- July 12, 2006
- July 13, 2006
- July 25, 2006
- July 28, 2006
- August 01, 2006
- August 02, 2006
- August 05, 2006
- August 07, 2006
- August 08, 2006
- August 15, 2006
- August 22, 2006
- August 24, 2006
- August 27, 2006
- September 06, 2006
- September 07, 2006
- September 08, 2006
- September 11, 2006
- September 13, 2006
- September 14, 2006
- September 15, 2006
- September 21, 2006
- September 25, 2006
- October 02, 2006
- October 03, 2006
- October 25, 2006
- November 01, 2006
- November 10, 2006
- November 14, 2006
- November 15, 2006
- November 16, 2006
- November 17, 2006
- November 18, 2006
- November 20, 2006
- November 21, 2006
- November 29, 2006
- November 30, 2006
- December 08, 2006
- December 09, 2006