Big Data at NIST

Background

The NIST Big Data Public Workinig Group (NBD-PWG) was established together with the industry, academia and government to create a consensus-based extensible Big Data Interoperability Framework (NBDIF) which is a vendor-neutral, technology- and infrastructure-independent ecosystem. It can enable Big Data stakeholders (e.g. data scientists, researchers, etc.) to utilize the best available analytics tools to process and derive knowledge through the use of standard interfaces between swappable architectural components. The NBDIF is being developed in three stages with the goal to achieve the following with respect to the NIST Big Data Reference Architecture (NBD-RA):

1. Identify the high-level Big Data reference architecture key components, which are technology, infrastructure, and vendor agnostic;
2. Define general interfaces between the NBD-RA components with the goals to aggregate low-level interactions into high-level general interfaces and produce set of white papers to demonstrate how NBD-RA can be used;
3. Validate the NBD-RA by building Big Data general applications through the general interfaces.

The NBDIF Version 3 final documents are available here.
The NBDIF Version 2 final documents are available here.
The NBDIF Version 1 final documents are available here.