Accessing National Water Model (NWM) Data via Google Cloud BigQuery API
Image Source: https://github.com/BYU-Hydroinformatics/api-nwm-gcp
Several important historical and ongoing National Water Model (NWM) datasets are now available on Google Cloud BigQuery, which makes them queryable through SQL using Google Cloud console. Some of these data sets are also accessible through an API (e.g. using Python). These datasets and their current status are as follows:
| Product | Cloud Console SQL | CIROH API | Historical | Daily Updates |
| Medium-range forecasts | X | X | X | X |
| Long-range forecasts | X | X | X | X |
| Analysis and Assimilation | X | X | X | X |
| Retrospective Data (NWM v3) | X | X | ||
| Return Periods | X | X |
To gain access and run queries on BigQuery:
- Submit the NWM BigQuery API Access Form, available at: https://docs.ciroh.org/docs/products/Data%20Management%20and%20Access%20Tools/bigqeury-api/
- Once approved, the CIROH IT team will cover the costs associated with your queries.
- Initially, each organization or project may request a usage limit of up to $500 per month for accessing the data through BigQuery.
This service offers a convenient and efficient way to interact with NWM data for your research and analysis needs.
Public-Private Partnership: Advancing Water Resource Management
The National Water Model (NWM) BigQuery project exemplifies a successful collaboration between public and private sectors, uniting government-generated data with modern, cutting-edge cloud technology. This collaboration addresses several key aspects:
- Improved Data Access: By leveraging Google Cloud BigQuery, a private sector platform, the project dramatically improves access to public NWM data. This partnership makes valuable water resource information more readily available to researchers, policymakers, and the public.
- Technological Innovation: The integration of NWM data with BigQuery showcases how private sector technology can enhance the utility of public sector data. This synergy promotes innovation in data analysis and visualization techniques.
- Cost-Effective Solutions: The CIROH DevOps team's commitment to covering query costs demonstrates how public funding can be strategically used to make private sector tools accessible to a wider audience, particularly in the academic and research communities.
- Capacity Building: This initiative helps build capacity across sectors by providing researchers and organizations with powerful tools to analyze water resource data, potentially leading to better-informed decision-making in water management.
- Scalability and Efficiency: By utilizing Google's cloud infrastructure, the project ensures that the growing volume of NWM data can be efficiently stored, accessed, and analyzed, addressing the scalability challenges often faced by public sector IT resources.
- Cross-Sector Collaboration: This project fosters collaboration between government agencies, academic institutions, and private technology companies, creating a model for future partnerships in environmental and resource management.
- Open Science Promotion: By making NWM data more accessible, this partnership supports the principles of open science, encouraging transparency and reproducibility in water resource research.
This public-private partnership not only enhances the value of the National Water Model but also sets a precedent for future collaborations that can drive innovation in environmental data management and analysis.
