Thread 'CPDN'

Message boards : Projects : CPDN
Message board moderation

To post messages, you must log in.

AuthorMessage
ProfileBill Freauff
Avatar

Send message
Joined: 26 Mar 11
Posts: 252
United States
Message 119277 - Posted: 1 Jun 2026, 3:20:35 UTC

It is interesting one year ago CPDN had over 47K tasks actively being crunched. Today it is less than 100 Tasks being worked.

Bill F
ID: 119277 · Report as offensive     Reply Quote
ProfileDave
Help desk expert

Send message
Joined: 28 Jun 10
Posts: 3323
United Kingdom
Message 119279 - Posted: 1 Jun 2026, 4:26:57 UTC - in response to Message 119277.  
Last modified: 1 Jun 2026, 4:29:54 UTC

In reply to Bill Freauff's message of 1 Jun 2026:
It is interesting one year ago CPDN had over 47K tasks actively being crunched. Today it is less than 100 Tasks being worked.

Bill F
That 47K will have included many tasks that had been abandoned from model types that have not been used for years. Since then they have had a clear out. only the tasks from the two current batches are now shown as active. The first of 2048 tasks has 95% of the tasks completed and validated. The second smaller batch is just 200 tasks with a code change to allow up to 8 cores per task to be used. Assuming the smaller test batch is successful, all work using the code from the European Centre for Medium range Weather Forecasting will in future allow up to 8 cores per task.

Another reason for the change is that CPDN has switched to deadlines of a couple of months rather than a year which was a hangover from the days when tasks could take over 6 months to complete on slower machines. (I successfully completed tasks on an Intel Atom netbook to prove it could be done! The downside is that as climate models become more complex taking more variables into account, they do become more demanding and require more recent hardware to run. (The current multi-core tasks require a smidgeon over 26GB of RAM per task at peak demand. At least now the figure on the server status page of 180 tasks in progress is fairly accurate.

It would be nice if there were a more constant supply of work from CPDN but for some years now, the work has not in the main been generated by Oxford Uni but comes from research projects in universities around the world ranging from masters degrees to post doc work.
ID: 119279 · Report as offensive     Reply Quote
ProfileDave
Help desk expert

Send message
Joined: 28 Jun 10
Posts: 3323
United Kingdom
Message 119283 - Posted: 1 Jun 2026, 18:33:05 UTC

News from Glenn, Honorary Researcher

CPDN are pleased to announce we will be adding the Weather Research and Forecasting Model (WRF) to CPDN. WRF is a state-of-the-art atmospheric modeling system from NCAR in the USA. It is designed for both meteorological research and numerical weather prediction. It offers a host of options for atmospheric processes and can run on a variety of computing platforms. It has a long history of development and extensive use in the meteorological community.

Development work to add WRF into CPDN is well advanced and we plan to deploy a test version of the application in the next couple of weeks. More technical details will be available then, however, it will be linux-only to begin with and multi-core.

It will be used for a project looking at urban heat islands led by scientists at Oxford University.


The addition of a new model type to add to the OIFS and Met Office models increases the number of scientists who can use CPDN for their work. I look forward to seeing them!
ID: 119283 · Report as offensive     Reply Quote

Message boards : Projects : CPDN

Copyright © 2026 University of California.
Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.