Building a scientific data grid with DIGS

Mark G. Beckett; Chris R. Allton; Christine T. H. Davies; Ilan Davis; Jonathan M. Flynn; Eilidh J. Grant; Russell S. Hamilton; Alan C. Irving; R. D. Kenway; Radoslaw H. Ostrowski; James T. Perry; Jason R. Swedlow; Arthur Trew

doi:10.1098/rsta.2009.0050

Building a scientific data grid with DIGS

Mark G. Beckett, Chris R. Allton, Christine T. H. Davies, Ilan Davis, Jonathan M. Flynn, Eilidh J. Grant, Russell S. Hamilton, Alan C. Irving, R. D. Kenway, Radoslaw H. Ostrowski, James T. Perry, Jason R. Swedlow, Arthur Trew

Research output: Contribution to journal › Article › peer-review

2 Citations (Scopus)

Abstract

We provide an insight into the challenge of building and supporting a scientific data infrastructure with reference to our experience working with scientists from computational particle physics and molecular biology. We illustrate how, with modern high-performance computing resources, even small scientific groups can generate huge volumes (petabytes) of valuable scientific data and explain how grid technology can be used to manage, publish, share and curate these data. We describe the DIGS software application, which we have developed to meet the needs of smaller communities and we have highlighted the key elements of its functionality.

Original language	English
Pages (from-to)	2471-2481
Number of pages	11
Journal	Philosophical Transactions of the Royal Society A - Mathematical Physical and Engineering Sciences
Volume	367
Issue number	1897
DOIs	https://doi.org/10.1098/rsta.2009.0050
Publication status	Published - 28 Jun 2009

Keywords

scientific data infrastructure
distributed data management
grid
molecular biology
computational particle physics

Access to Document

10.1098/rsta.2009.0050

Cite this

Beckett, M. G., Allton, C. R., Davies, C. T. H., Davis, I., Flynn, J. M., Grant, E. J., Hamilton, R. S., Irving, A. C., Kenway, R. D., Ostrowski, R. H., Perry, J. T., Swedlow, J. R., & Trew, A. (2009). Building a scientific data grid with DIGS. Philosophical Transactions of the Royal Society A - Mathematical Physical and Engineering Sciences, 367(1897), 2471-2481. https://doi.org/10.1098/rsta.2009.0050

@article{2671db2c08dc4443982255403722d0e3,

title = "Building a scientific data grid with DIGS",

abstract = "We provide an insight into the challenge of building and supporting a scientific data infrastructure with reference to our experience working with scientists from computational particle physics and molecular biology. We illustrate how, with modern high-performance computing resources, even small scientific groups can generate huge volumes (petabytes) of valuable scientific data and explain how grid technology can be used to manage, publish, share and curate these data. We describe the DIGS software application, which we have developed to meet the needs of smaller communities and we have highlighted the key elements of its functionality.",

keywords = "scientific data infrastructure, distributed data management, grid, molecular biology, computational particle physics",

author = "Beckett, {Mark G.} and Allton, {Chris R.} and Davies, {Christine T. H.} and Ilan Davis and Flynn, {Jonathan M.} and Grant, {Eilidh J.} and Hamilton, {Russell S.} and Irving, {Alan C.} and Kenway, {R. D.} and Ostrowski, {Radoslaw H.} and Perry, {James T.} and Swedlow, {Jason R.} and Arthur Trew",

year = "2009",

month = jun,

day = "28",

doi = "10.1098/rsta.2009.0050",

language = "English",

volume = "367",

pages = "2471--2481",

journal = "Philosophical Transactions of the Royal Society A - Mathematical Physical and Engineering Sciences",

issn = "1364-503X",

publisher = "The Royal Society",

number = "1897",

}

Beckett, MG, Allton, CR, Davies, CTH, Davis, I, Flynn, JM, Grant, EJ, Hamilton, RS, Irving, AC, Kenway, RD, Ostrowski, RH, Perry, JT, Swedlow, JR & Trew, A 2009, 'Building a scientific data grid with DIGS', Philosophical Transactions of the Royal Society A - Mathematical Physical and Engineering Sciences, vol. 367, no. 1897, pp. 2471-2481. https://doi.org/10.1098/rsta.2009.0050

TY - JOUR

T1 - Building a scientific data grid with DIGS

AU - Beckett, Mark G.

AU - Allton, Chris R.

AU - Davies, Christine T. H.

AU - Davis, Ilan

AU - Flynn, Jonathan M.

AU - Grant, Eilidh J.

AU - Hamilton, Russell S.

AU - Irving, Alan C.

AU - Kenway, R. D.

AU - Ostrowski, Radoslaw H.

AU - Perry, James T.

AU - Swedlow, Jason R.

AU - Trew, Arthur

PY - 2009/6/28

Y1 - 2009/6/28

N2 - We provide an insight into the challenge of building and supporting a scientific data infrastructure with reference to our experience working with scientists from computational particle physics and molecular biology. We illustrate how, with modern high-performance computing resources, even small scientific groups can generate huge volumes (petabytes) of valuable scientific data and explain how grid technology can be used to manage, publish, share and curate these data. We describe the DIGS software application, which we have developed to meet the needs of smaller communities and we have highlighted the key elements of its functionality.

AB - We provide an insight into the challenge of building and supporting a scientific data infrastructure with reference to our experience working with scientists from computational particle physics and molecular biology. We illustrate how, with modern high-performance computing resources, even small scientific groups can generate huge volumes (petabytes) of valuable scientific data and explain how grid technology can be used to manage, publish, share and curate these data. We describe the DIGS software application, which we have developed to meet the needs of smaller communities and we have highlighted the key elements of its functionality.

KW - scientific data infrastructure

KW - distributed data management

KW - grid

KW - molecular biology

KW - computational particle physics

U2 - 10.1098/rsta.2009.0050

DO - 10.1098/rsta.2009.0050

M3 - Article

C2 - 19451103

SN - 1364-503X

VL - 367

SP - 2471

EP - 2481

JO - Philosophical Transactions of the Royal Society A - Mathematical Physical and Engineering Sciences

JF - Philosophical Transactions of the Royal Society A - Mathematical Physical and Engineering Sciences

IS - 1897

ER -

Building a scientific data grid with DIGS

Abstract

Keywords

Access to Document

Fingerprint

Cite this