Building a scientific data grid with DIGS

Mark G. Beckett, Chris R. Allton, Christine T. H. Davies, Ilan Davis, Jonathan M. Flynn, Eilidh J. Grant, Russell S. Hamilton, Alan C. Irving, R. D. Kenway, Radoslaw H. Ostrowski, James T. Perry, Jason R. Swedlow, Arthur Trew

    Research output: Contribution to journalArticle

    1 Citation (Scopus)

    Abstract

    We provide an insight into the challenge of building and supporting a scientific data infrastructure with reference to our experience working with scientists from computational particle physics and molecular biology. We illustrate how, with modern high-performance computing resources, even small scientific groups can generate huge volumes (petabytes) of valuable scientific data and explain how grid technology can be used to manage, publish, share and curate these data. We describe the DIGS software application, which we have developed to meet the needs of smaller communities and we have highlighted the key elements of its functionality.

    Original languageEnglish
    Pages (from-to)2471-2481
    Number of pages11
    JournalPhilosophical Transactions of the Royal Society A - Mathematical Physical and Engineering Sciences
    Volume367
    Issue number1897
    DOIs
    Publication statusPublished - 28 Jun 2009

    Keywords

    • scientific data infrastructure
    • distributed data management
    • grid
    • molecular biology
    • computational particle physics

    Cite this

    Beckett, M. G., Allton, C. R., Davies, C. T. H., Davis, I., Flynn, J. M., Grant, E. J., Hamilton, R. S., Irving, A. C., Kenway, R. D., Ostrowski, R. H., Perry, J. T., Swedlow, J. R., & Trew, A. (2009). Building a scientific data grid with DIGS. Philosophical Transactions of the Royal Society A - Mathematical Physical and Engineering Sciences, 367(1897), 2471-2481. https://doi.org/10.1098/rsta.2009.0050