Earth:SensorThings API

From HandWiki
OGC SensorThings API - Part 1 Sensing
StatusOGC Standard Implementation Specification
Year started2015
Latest version1.0
EditorsSteve Liang (SensorUp), Chih-Yuan Huang (National Central University), Tania Khalafbeigi (SensorUp)
Base standardsJSON, OGC/ISO 19156:2011 O&M
DomainOpen Geospatial Consortium, Internet of Things
AbbreviationOGC STA
WebsiteOGC SensorThings API Standard GitHub Page
OGC SensorThings API - Part 2 Tasking Core
StatusOGC Standard Implementation Specification
Year started2018
Latest version1.0
EditorsSteve Liang (SensorUp), Tania Khalafbeigi (SensorUp)
Base standardsOGC SPS
DomainOpen Geospatial Consortium, Internet of Things
AbbreviationOGC STA
WebsiteOGC SensorThings API Standard GitHub Page
OGC SensorThings API - Part 2 Tasking Core Discussion Paper
StatusOGC Discussion Paper
Year started2018
Latest version1.0
EditorsSteve Liang (SensorUp), Tania Khalafbeigi (SensorUp), Kan Luo(University of Calgary)
Base standardsOGC SensorThings
DomainOpen Geospatial Consortium, Internet of Things
AbbreviationOGC STA
WebsiteOGC SensorThings API Tasking Core Discussion Paper download page

SensorThings API[1] is an Open Geospatial Consortium (OGC) standard providing an open and unified framework to interconnect IoT sensing devices, data, and applications over the Web. It is an open standard addressing the syntactic interoperability and semantic interoperability of the Internet of Things. It complements the existing IoT networking protocols such CoAP, MQTT, HTTP, 6LowPAN. While the above-mentioned IoT networking protocols are addressing the ability for different IoT systems to exchange information, OGC SensorThings API is addressing the ability for different IoT systems to use and understand the exchanged information. As an OGC standard, SensorThings API also allows easy integration into existing Spatial Data Infrastructures or Geographic Information Systems.

OGC SensorThings API has two parts: (1) Part I - Sensing and (2) Part II - Tasking. OGC SensorThings API Part I - Sensing was released for public comment on June 18, 2015.[2] The OGC Technical Committee (TC) approves start of electronic vote on December 3, 2015, and the SensorThings API Part I - Sensing passed the TC vote on February 1, 2016. The official OGC standard specification was published online on July 26, 2016. In 2019 the SensorThings API was also published as a United Nation's ITU-T Technical Specification.[3]

OGC SensorThings API Part II - Tasking Core was released for public comment on February 20, 2018,[4] and it passed the TC vote on June 1, 2018. The official OGC standard specification for the SensorThings API Part II - Tasking Core was published online on January 8, 2019.

In order to offer a better developer experience, the SensorThings API Part II - Tasking Core Discussion Paper was published online on December 18, 2018. The Tasking Core Discussion paper provides 15 JSON examples showing how SensorThings API Part II - Tasking Core can be used.

Design

SensorThings API is designed specifically for resource-constrained IoT devices and the Web developer community. It follows REST principles, the JSON encoding, and the OASIS OData protocol and URL conventions. Also, it has an MQTT extension allowing users/devices to publish and subscribe updates from devices, and can use CoAP in addition to HTTP.

SensorThings API data model

The foundation of the SensorThings API is its data model that is based on the ISO 19156 (ISO/OGC Observations and Measurements), that defines a conceptual model for observations, and for features involved in sampling when making observations. In the context of the SensorThings, the features are modelled as Things, Sensors (i.e., Procedures in O&M), and Feature of Interests. As a result, the SensorThings API provides an interoperable Observation-focus view, that is particularly useful to reconcile the differences between heterogeneous sensing systems (e.g., in-situ sensors and remote sensors).

An IoT device or system is modelled as a Thing. A Thing has an arbitrary number of Locations (including 0 Locations) and an arbitrary number of Datastreams (including 0 Datastreams). Each Datastream observes one ObservedProperty with one Sensor and has many Observations collected by the Sensor. Each Observation observes one particular FeatureOfInterest. The O&M based model allows SensorThings to accommodate heterogeneous IoT devices and the data collected by the devices.[5]

SensorThings API provides two main functionalities, each handled by a part. The two profiles are the Sensing part and the Tasking part. The Sensing part provides a standard way to manage and retrieve observations and metadata from heterogeneous IoT sensor systems, and the Sensing part functions are similar to the OGC Sensor Observation Service. The Tasking part provides a standard way for parameterizing - also called tasking - of task-able IoT devices, such as sensors or actuators. The Tasking part functions are similar to the OGC Sensor Planning Service. The Sensing part is designed based on the ISO/OGC Observations and Measurements (O&M) model, and allows IoT devices and applications to CREATE, READ, UPDATE, and DELETE (i.e., HTTP POST, GET, PATCH, and DELETE) IoT data and metadata in a SensorThings service.

Entities (Resources)

SensorThings API Part I - Sensing defines the following resources. As SensorThings is a RESTful web service, each entity can be CREATE, READ, UPDATE, and DELETE with standard HTTP verbs (POST, GET, PATCH, and DELETE):[6][7]

  • Thing: An object of the physical world (physical things) or the information world (virtual things) that is capable of being identified and integrated into communication networks.[8]
  • Locations: Locates the Thing or the Things it associated with.
  • HistoricalLocations: Set provides the current (i.e., last known) and previous locations of the Thing with their time.
  • Datastream: A collection of Observations and the Observations in a Datastream measure the same ObservedProperty and are produced by the same Sensor.
  • ObservedProperty : Specifies the phenomenon of an Observation.
  • Sensor : An instrument that observes a property or phenomenon with the goal of producing an estimate of the value of the property.
  • Observation: Act of measuring or otherwise determining the value of a property.[9]
  • FeatureOfInterest: An Observation results in a value being assigned to a phenomenon.The phenomenon is a property of a feature, the latter being the FeatureOfInterest of the Observation.[9]

In addition to the above sensing resources, SensorThings API Part II - Tasking Core defines the following resources:[10]

  • TaskingCapabilities: Specifies the task-able parameters of an actuator.
  • Tasks: A collection of Tasks that has been created.
  • Actuator : A type of transducer that converts a signal to some real-world action or phenomenon.[11]

Example Payload

http://example.org/v1.0/Datastream(id)/Observations

{
  "@iot.count": 2,
  "value": [
    {
      "@iot.id": 1,
      "@iot.selfLink": "http://example.org/v1.0/Observations(1)",
      "phenomenonTime": "2016-01-01T05:00:00.000Z",
      "result": "-9",
      "resultTime": null,
      "Datastream@iot.navigationLink": "http://example.org/v1.0/Observations(1)/Datastream",
      "FeatureOfInterest@iot.navigationLink": "http://example.org/v1.0/Observations(1)/FeatureOfInterest"
    },
    {
      "@iot.id": 2,
      "@iot.selfLink": "http://example.org/v1.0/Observations(2)",
      "phenomenonTime": "2016-01-01T04:00:00.000Z",
      "result": "-10",
      "resultTime": null,
      "Datastream@iot.navigationLink": "http://example.org/v1.0/Observations(2)/Datastream",
      "FeatureOfInterest@iot.navigationLink": "http://example.org/v1.0/Observations(2)/FeatureOfInterest"
    }
  ]
}

Data Array Extensions

In order to reduce the data size transmitted over the network, SensorThings API data array extension allows users to request for multiple Observation entities and format the entities in the dataArray format. When a SensorThings service returns a dataArray response, the service groups Observation entities by Datastream or MultiDatastream, which means the Observation entities that link to the same Datastream or the same MultiDatastream are aggregated in one dataArray.

Example request for data array

http://example.org/v1.0/Observations?$resultFormat=dataArray

Example data array response

{
  "value": [
    {
      "Datastream@iot.navigationLink": "http://example.org/v1.0/Datastreams(1)",
      "components": [
        "id",
        "phenomenonTime",
        "resultTime",
        "result"
      ],
      "dataArray@iot.count": 3,
      "dataArray": [
        [
          1,
          "2005-08-05T12:21:13Z",
          "2005-08-05T12:21:13Z",
          20
        ],
        [
          2,
          "2005-08-05T12:22:08Z",
          "2005-08-05T12:21:13Z",
          30
        ],
        [
          3,
          "2005-08-05T12:22:54Z",
          "2005-08-05T12:21:13Z",
          0
        ]
      ]
    }
  ]
}

Evaluation

Interoperability between OpenIoT and SensorThings "We believe that the implementation of the SensorThing API will be a major improvement for the OpenIoT middleware. It will give OpenIoT a standardized and truly easy to use interface to sensor values.This will complement the rich semantic reasoning services with a simple resource based interface. And the consistent data model mapping gives both a common context to describe the internet of things".[12]

Efficiency of SensorThings API A comprehensive evaluation of the SensorThings API is published in Jazayeri, Mohammad Ali, Steve HL Liang, and Chih-Yuan Huang. "Implementation and Evaluation of Four Interoperable Open Standards for the Internet of Things." Sensors 15.9 (2015): 24343-24373.

Quotes

SensorThings API was demonstrated in a pilot project[13] sponsored by the Department of Homeland Security Science and Technology Directorate. Dr. Reginald Brothers, the Undersecretary of the Homeland Security Science and Technology, was "impressed with the ‘state of the practical’ where these various industry sensors can be integrated today using open standards that remove the stovepipe limitations of one-off technologies.[14] "

OGC SensorThings API Standard Specification

Free and Open Source SensorThings API Implementations

Whiskers

In March 2016 SensorUp and the GeoSensorWeb Lab at the University of Calgary submitted an open source software project proposal to the Eclipse Foundation and has been approved. The project is called Whiskers.[15] Whiskers is an OGC SensorThings API framework. It will have a JavaScript client and a light-weight server for IoT gateway devices (e.g., Raspberry Pi or BeagleBone). Whiskers aim to foster a healthy and open IoT ecosystem, as opposed to one dominated by proprietary information silos. Whiskers aims to make SensorThings development easy for the large and growing world of IoT developers.

GOST

GOST[16] is an open source implementation of the SensorThings API in the Go programming language initiated by Geodan. It contains easily deployable server software and a JavaScript client. Currently (June 2016) it is in development but a first version can already be downloaded and deployed. The software can be installed on any device supporting Docker or Go (e.g. Windows, Linux, Mac OS and Raspberry Pi). By default sensor data is stored in a PostgreSQL database.

FROST

FROST-Server[17] is an Open Source server implementation of the OGC SensorThings API. FROST-Server implements the entire specification, including all extensions. It is written in Java and can run in Tomcat or Wildfly and is available as a Docker image. Among its many features is the ability to use String or UUID based entity IDs.

FROST-Client[18] is a Java client library for communicating with a SensorThings API compatible server.

SensorThings HcDT Charting SDK

SensorThings HcDT[19] is a JavaScript charting library for the OGC SensorThings API. It is based on the open source[clarification needed] Highcharts library and DataTables. It is a front-end charting library enable developers to connect to datastreams from any OGC SensorThings API service, and display the sensor observations in charts, tables, or dashboard widgets for web applications.

Mozilla STA

Mozilla developed a node implementation of the OGC SensorThings API.[20]

52°North STA

52N SensorThingsAPI[21] is an open source implementation of the OGC SensorThings API. Its core features are the interoperability with the 52N SOS implementing the OGC Sensor Observation Service, customizable database mappings and several convenience extensions. It can be deployed as a Docker container, inside an Apache Tomcat or as a standalone application.

Example Applications

Department of Homeland Security S&T Shaken Fury Operational Experiment

In 2019 the Shaken Fury operational experiment[22] for the DHS Next Generation First Responder program depicts a scenario of an earthquake causing partial structural collapse and HAZMAT leak at a stadium. OGC SensorThings API is used as the standard interface[23] that interconnects multiple sensors and offers an IoT enabled real-time situational awareness.

Smart Citizens for Smart Cities YYC - Crowd-sourced Air Quality Sensing

On Oct 8th 2016,[24] a group of volunteers (smart citizens) in Calgary gathered together, assembled their own sensors, installed at their houses, and formed a crowd-sourced air quality sensor network. All data are publicly available via OGC SensorThings API.[25] This citizen sensing efforts increased the number of Calgary's air quality sensors from 3 to more than 50.

Smart Emission Project in Nijmegen, NL

Smart emission[26] is an air quality monitoring project in the city of Nijmegen, NL. The project deployed multiple air quality sensors throughout the city. Data are published with open standards, including OGC SensorThings API. Part of the project is an open source ETL engine to load the project sensor data into an OGC SensorThings API.[27]

SensorThings Dashboard

This dashboard provides easy-to-use client-side visualisation of Internet-of-Things sensor data from OGC SensorThings API compatible servers. Various types of widgets can be arranged and configured on the dashboard. It is a web application and can be embedded into any website. A live demo is available on the project page. https://github.com/SensorThings-Dashboard/SensorThings-Dashboard

GOST Dashboard v2

GOST Dashboard v2 is an open source library of custom HTML elements (web components) supporting SensorThings API. These elements facilitate the development of HTML applications integrating functionality and data from SensorThings API compatible services. The components are developed with Predix-UI and Polymer.

AFarCloud project OGC Connector

The connector enables interoperability between OGC-compliant data sources and the semantic middleware[28] developed in the Horizon 2020 ECSEL project AFarCloud. It is a modular Java application with Docker-based deployment, implemented according to the 15-078r6 OGC SensorThings API 1.0 Implementation Standard.

Comparison between OGC SensorThings API and OGC Sensor Observation Services

SensorThings API provides functions similar to the OGC Sensor Observation Service, an OGC specification approved in 2005. Both standard specifications are under the OGC Sensor Web Enablement standard suite. The following table summarizes the technical difference between the two specifications.[29]

OGC SensorThings API OGC Sensor Observation Service (SOS)
Encoding JSON XML
Architecture Style Resource Oriented Architecture Service Oriented Architecture
Binding REST SOAP
Inserting new sensors or observations HTTP POST (e.g., CRUD) using SOS specific interfaces, e.g., RegisterSensor(), InsertObservation()
Deleting existing sensors HTTP DELETE using SOS specific interfaces, i.e., DeleteSensor()
Pagination $top, $skip, $nextLink Not Supported
Pub/Sub Support MQTT and SensorThings MQTT Extension Not Supported
Updating properties of existing sensors or observations HTTP PATCH and JSON PATCH Not Supported
Deleting observations HTTP DELETE Not Supported
Linked data support JSON-LD Not Supported
Return only the properties selected by the client $select Not Supported
Return multiple O&M entities (e.g., FeatureOfInterest and Observation) in one request/response $expand Not Supported

Links

  1. SensorThings API - GitHub
  2. Presentation: Sensor up your connected applications with OGC SensorThings API (FOSS4G)
  3. Chapter: Mapping the OGC SensorThings API onto the OpenIoT Middleware
  4. Tutorial in YouTube: Getting Started Series #1, SensorThings Tutorial Series #2 and SensorThings Tutorial Series #3
  5. Application: SensorThings Playground allows interested people and organizations to experiment with a SensorThings system via a friendly, step-by-step process.

References

  1. "OGC SensorThings API". http://www.opengeospatial.org/standards/sensorthings. 
  2. "OGC seeks public comment on SensorThings API standard for Internet of Things | OGC". http://www.opengeospatial.org/pressroom/pressreleases/2238. 
  3. "Technical Specification D3.2 - SensorThings API - Sensing". https://www.itu.int/pub/T-FG-DPM-2019-3.2. 
  4. "OGC seeks public comment on 'SensorThings API Part 2 – Tasking Core' Candidate Standard for use in the Internet of Things | OGC" (in en). http://www.opengeospatial.org/pressroom/pressreleases/2739. 
  5. "API Reference". http://www.sensorup.com/docs/?json#introduction. 
  6. 6.0 6.1 Liang, Steve, ed (2016-07-26). OGC® SensorThings API Part 1: Sensing. http://docs.opengeospatial.org/is/15-078r6/15-078r6.html. 
  7. "SensorThings Data Model". https://ogc-iot.github.io/ogc-iot-api/datamodel.html. 
  8. tsbmail. "Y.2060 : Overview of the Internet of things". https://www.itu.int/rec/T-REC-Y.2060-201206-I. 
  9. 9.0 9.1 "ISO 19156:2011 - Geographic information -- Observations and measurements". http://www.iso.org/iso/catalogue_detail.htm?csnumber=32574. 
  10. 10.0 10.1 Liang, Steve, ed (2019-01-08). OGC® SensorThings API Part 2: Tasking Core. http://docs.opengeospatial.org/is/17-079r1/17-079r1.html. 
  11. "Sensor Model Language (SensorML) | OGC" (in en). http://www.opengeospatial.org/standards/sensorml. 
  12. Schaaf, Hylke van der; Herzog, Reinhard (2015-01-01). Žarko, Ivana Podnar. ed (in en). Mapping the OGC SensorThings API onto the OpenIoT Middleware. Lecture Notes in Computer Science. Springer International Publishing. pp. 62–70. doi:10.1007/978-3-319-16546-2_6. ISBN 9783319165455. 
  13. "OGC announces successful completion of Incident Management Information Sharing IoT Pilot". http://www.opengeospatial.org/pressroom/pressreleases/2394. 
  14. "S&T's Internet of Things Pilot Demonstrates 'State of the Practical'". 2016-01-25. https://www.dhs.gov/science-and-technology/blog/2016/01/25/st-internet-things-pilot-demonstrates-state-practical. 
  15. "Whisker, an Eclipse project proposal". 2016-03-11. https://projects.eclipse.org/proposals/whiskers. 
  16. "Geodan/gost". https://github.com/gost/home. 
  17. "FraunhoferIOSB/FROST-Server". https://github.com/FraunhoferIOSB/FROST-Server. 
  18. "FraunhoferIOSB/FROST-Client". https://github.com/FraunhoferIOSB/FROST-Client. 
  19. "SensorThings Highchart and DataTable (HcDT) | SensorUp". http://www.sensorup.com/sensorthings-high-chart-and-data-table-hcdt/. 
  20. "mozilla-sensorweb/sensorthings" (in en). https://github.com/mozilla-sensorweb/sensorthings. 
  21. 52North/sensorweb-server-sta, 52°North Initiative for Geospatial Open Source Software GmbH, 2020-11-17, https://github.com/52North/sensorweb-server-sta, retrieved 2020-11-24 
  22. "News Release: S&T, Industry, Responders Partner to Evaluate Tech" (in en). 2019-06-10. https://www.dhs.gov/science-and-technology/news/2019/06/10/news-release-st-industry-responders-partner-evaluate-tech. 
  23. "NGFR Integration Handbook" (in en). 2018-02-06. https://www.dhs.gov/science-and-technology/ngfr/handbook. 
  24. "Calgary sensor pilot helps you plan a run with the best air quality | Metro News". metronews.ca. http://metronews.ca/news/calgary/2016/09/27/calgary-sensor-pilot-helps-you-plan-a-run-best-air-quality.html. 
  25. "Air Quality in Calgary". http://calgary-air.sensorup.com/. 
  26. contributors, Just van den Broecke - Geonovum original: Mark Otto, Jacob Thornton, and Bootstrap. "Smart Emission". http://data.smartemission.nl/. 
  27. "Geonovum/smartemission". https://github.com/Geonovum/smartemission/tree/master/etl. 
  28. Kepka, Michal; Černý, Lukáš; Brada, Premek (November 2020). "An open system for monitoring environmental phenomena: Poster abstract". Proceedings of the 18th Conference on Embedded Networked Sensor Systems. ACM. pp. 659–660. doi:10.1145/3384419.3430443. ISBN 9781450375900. 
  29. "Comparison of SensorThings API and Sensor Observation Service". http://www.sensorup.com/index.php/2016/03/01/comparison-of-sensorthings-api-and-sensor-observation-service/.