MLOps.community UN Global Platform // Mark Craddock // Co-Founder & CTO, Global Certification and Training Ltd // MLOps Meetup #42
MLOps community meetup #42! Last Wednesday, we talked to Mark Craddock, Co-Founder & CTO, Global Certification and Training Ltd (GCATI), about the UN Global Platform.
Join the Community: https://go.mlops.community/YTJoinIn
Get the newsletter: https://go.mlops.community/YTNewsletter
// Abstract:
Building a global big data platform for the UN. Streaming 600,000,000+ records/day into the platform. The strategy was developed using Wardley Maps and the Platform Design Toolkit.
// Bio:
Mark contributed to the Cloud First policy for the UK Public sector and was one of the founding architects for the UK Government's G-Cloud program. Mark developed the initial CloudStore, which enabled the UK Public Sector to procure cloud services from over 2,500 suppliers. The UK Public Sector has now purchased over £6.3Bn of cloud services, with £3.6Bn from Small to Medium Enterprises in the UK.
Mark led the development of the United Nations Global Platform. A multi-cloud platform for capacity building within the national statistics offices in the use of Big Data and its integration with administrative sources, geospatial information, traditional survey, and census data.
Mark is now building a non-profit training and certification organization.
----------- Connect With Us ✌️-------------
Join our Slack community: https://go.mlops.community/slack
Follow us on Twitter: @mlopscommunity
Sign up for the next meetup: https://go.mlops.community/register
Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/
Connect with Mark on LinkedIn: https://www.linkedin.com/in/markcraddock/
Timestamps:
[0:00] - Intro to Mark Craddock
[03:35] - Mark's background
[05:05] - UN Global Platform
[05:18] - Vision: A global collaboration to harness the power of data for better lives
[05:37] - UN GWG (Big) Data Membership
[05:49] - Sustainable Development Goals
[06:21] - Using the platform
[06:30] - Approach
[06:44] - Principles
[07:29] - How big was the team that put this together?
[08:09] - Leave no one behind. Endeavor to reach the furthest behind first.
[08:24] - Platform Business Model
[10:06] - Six distinct aspects of a platform and its ecosystem
[10:46] - The platform is the only business model able to orchestrate the wide range of products and services in an ecosystem
[11:09] - Through the means of a platform organization, ecosystems are capable of providing an improbable combination of attributes
[11:55] - Platforms and business models are also one of the best organizational structures for enabling rapid evolution
[13:22] - Technology Strategy
[13:23] - Wardley Maps
[14:50] - Is this where Machine Learning tools would fit in?
[20:35] - Are you looking at how fast these are moving across to the right? How can you gauge that?
[26:57] - Is the value fluid?
[28:43] - How did you factor in the different personas?
[30:34] - How do you enable loosely coupled teams?
[35:44] - Data also moves from left to right
[42:00] - Technology Strategy Handbook
[42:20] - Achievements - July '19
[42:31] - Global Billing Intelligence
[43:15] - Privacy-Preserving Techniques Handbook
[43:26] - Cryptographic Techniques
[44:12] - Global Big Datasets
[44:55] - Big Data
[47:41] - Automatic Identification System (AIS)
[48:14] - Automatic Dependent Surveillance (ADS-B)
[48:41] - Satellite Imagery
[49:11] - Services in the platform
[49:16] - Location Analytics Service
[50:06] - Stack Sample
[50:37] - Data Sources
[51:50] - NiFi Dataflow
[52:20] - Is this how you enabled reproducibility?
[53:47] - Location Analytics Service
[55:31] - Shanghai - Flights
[55:45] - Shanghai - Cargo Ships
[56:00] - UN Global Platform