6 posts tagged with "On-Premises Services"

The recent DevCon 2025 event showcased not just cutting-edge development practices, but also demonstrated how modern DevOps principles and cloud infrastructure can seamlessly support large-scale technical workshops. Our team had the privilege of providing IT infrastructure and support for over 200 attendees, creating a robust learning environment through an exemplary public-private partnership.

CIROH's Research Cyberinfrastructure and DevOps team.
Left to right, top to bottom:
Manjila Singh, Arpita Patel, Nia Minor, Trupesh Patel, James Halgren; Benjamin Lee.

The Power of Collaboration​

DevCon 2025 represented an outstanding example of what's possible when public institutions and private enterprises work together:

• Corporate Sponsors: AWS and Google Cloud provided funding and infrastructure for the event.
• Infrastructure Partners: NSF JetStream and 2i2c JupyterHub delivered the computational backbone.
• Technical Implementation: The CIROH Research Cyberinfrastructure and DevOps Team managed IT access and software packaging.

Our Technical Approach​

Supporting 200+ workshop attendees required careful planning and execution. Our DevOps team implemented:

Infrastructure as Code​

• Automated deployment of workshop environments
• Scalable JupyterHub instances configured for concurrent users
• Pre-packaged software environments ensuring consistency across all workstations

Cloud-Native Solutions​

• Leveraged AWS S3 bucket and Google Cloud BigQuery
• Implemented auto-scaling to handle peak workshop loads
• Ensured high availability across multiple availability zones

Seamless User Experience​

• Single sign-on authentication for 100+ participants using CIROH 2i2c JupyterHub
• Pre-configured JetStream2 environments with all necessary tools
• Real-time support channels for immediate issue resolution

Key Achievements​

• Zero Downtime: Maintained 100% uptime throughout the entire event
• Rapid Onboarding: All 200 attendees were able to access their environments within minutes
• Consistent Experience: Every participant had identical, fully-functional development environments
• Real-time Support: Our team resolved technical issues with average response time under 5 minutes

Lessons Learned​

This event perfectly demonstrated how DevOps principles—bridging development and operations—combined with cloud computing can transform organizational capabilities. Key takeaways include:

1. Automation is Essential: Pre-event automation allowed us to focus on attendee support rather than infrastructure management.
2. Public-Private Partnerships Work: Combining NSF's research infrastructure with commercial cloud providers created a best-of-both-worlds solution.
3. Preparation Prevents Problems: Our extensive pre-event testing and redundancy planning paid dividends during the live event.

Looking Forward​

The success of DevCon 2025's IT infrastructure demonstrates that large-scale technical events no longer need to be limited by traditional IT constraints. By embracing DevOps practices and leveraging cloud partnerships, we can create learning environments that scale effortlessly while maintaining reliability and performance.

We're proud to have supported the DevCon 2025 community and look forward to applying these lessons to future events. The combination of public research infrastructure, private cloud resources, and dedicated DevOps expertise created an environment where 200+ developers could focus on learning and innovation without worrying about technical barriers.

Last week, I had the incredible opportunity to co-present a keynote at the CIROH Developers Conference (DevCon 2025), which attracted over 200 attendees. This presentation, which I presented alongside Dan Ames, focused on "CIROH HydroInformatics and Research Cyberinfrastructure." It was a fantastic experience to share insights into the powerful tools and technologies that CIROH engineers, students, researchers have been developing to advance hydrological research and operations.

Our keynote aimed to showcase the comprehensive ecosystem that CIROH offers. We highlighted four key pillars:

• Computing Resources: CIROH offers accress to public cloud infrastructure, on-premises HPC, and NSF ACCESS resources.
• Data Management: CIROH members handle and share vast datasets crucial for hydrological modeling. We've provided platforms to do so through HydroShare and CIROH AWS S3 buckets, as well as streamlining access and analysis of this data through tools like Google BigQuery API and Tethys Platform.
• Model Development: CIROH develops tools and frameworks for developing and refining hydrological models, including the NGIAB ecosystem.
• Knowledge Sharing: CIROH disseminates findings and best practices through the DocuHub and Portal platforms.

Value and Impact​

During the keynote, we emphasized the value that CIROH brings to new students and researchers. This includes access to:

• Computational resources that would normally cost thousands of dollars.
• Datasets that would take months to compile.
• Tools that streamline research and increase its impact.

We also highlighted several key tools within the CIROH ecosystem that are pushing hydrology forward:

• NGIAB (NextGen In A Box) ecosystem: Provides power and portability to the NextGen water modeling framework through leading open-source software development.
• CIROH's DocuHub: A central repository for documentation, as well as a platform for monthly blog and news updates.
• CIROH Portal: Facilitates to data, tools, and research findings.
• Google BigQuery NWM API: An efficient alternative for accessing and querying National Water Model data.
• Tethys Platform: Empowers intuitive, accessible web applications to deliver data and model results.
• Pantarhei and Wukong HPC: CIROH's high-performance computing cluster for demanding computations.
• And many more!

Our overall message was that CIROH’s hydroinformatics and research cyberinfrastructure ecosystem is designed to support and amplify research efforts. We encouraged attendees to explore these resources and consider how they could be applied to their own work. Whether it's streamlining data workflows, tackling computationally intensive tasks, or sharing findings, CIROH provides the tools and infrastructure to push the boundaries of hydrological science.

We want to thank everyone who attended our keynote and engaged in the Mentimeter quiz. It’s an exciting time for hydroinformatics, and we’re thrilled to be a part of this dynamic community!

Video voiced by Quinn Lee and prepared by Manjila Singh, Nia Minor, and Arpita Patel.

Predicting water flow with precision across the vast U.S. landscape is a complex challenge. That's why Song et al. 2024 developed δHBV2.0, a cutting-edge hydrologic model. It’s built with high-resolution modeling of physics to deliver seamless, highly accurate streamflow simulations, even down to individual sub-basins. It's already proven to be a major improvement, performing better than older tools at about 4,000 measurement sites. We also provide a comprehensive 40-year water dataset for ~180,000 river reaches to support this.

Penn State research group pushed δHBV2.0 further, training it with even more detailed river data and integrating other trusted models, aiming to make it a key part of the NextGen national water modeling system (as a potential NWM3.0 successor). But here’s a common hurdle: making powerful scientific tools like this easy and reliable for everyone to use within a larger framework can be tough. Setup issues, runtime errors, and inconsistent results can frustrate users.

NGIAB stepped in to solve exactly this problem. Team has taken the complexity out of using the operations-ready models within NextGen by creating one unified, reliable package. Thanks to NGIAB, users don't have to worry about tricky setups or whether the model will run correctly. NGIAB ensures that our models are compatible everywhere and, most importantly, that they run exactly as designed, consistently and faithfully, every single time, no babysitting required. This means users get the full power of our advanced modeling, without the headaches.

Pennsylvania State University (PSU) researchers have been leveraging CIROH Cyberinfrastructure to tackle complex hydrological modeling challenges. This post highlights their innovative approach using the Wukong computing platform in conjunction with Amazon S3 bucket storage to efficiently process and analyze large-scale environmental datasets. 🚀

The CIROH team has been diligently accelerating research cyberinfrastructure capabilities this month. We're thrilled to share key milestones achieved in enhancing the Community NextGen project and our cloud/on-premises platforms.

Welcome to the February edition of the CIROH DocuHub blog, where we bring you the latest updates and news about the Community NextGen project and CIROH's Cloud and on-premise Infrastructure.

Our team has been hard at work enhancing CIROH's Infrastructure and Community NextGen tools. Here are some highlights from February 2024:

1. We successfully launched our new On-premises Infrastructure, which is now fully operational. You can find documentation for it here.