A A
en
Deutsch
English
Menü
Home Research XtreemFS

XtreemFS - A cloud file system

XtreemFS is a distributed and replicated file system for cloud and grid infrastructures; clients and servers can be distributed worldwide. XtreemFS builds a reliable storage system from standard off-the-shelve components through replication. The complexity of geographic distribution and replication is transparently provided as a POSIX file system. Applications and users do not see a difference in the API and semantics compared to local file systems. The research focus for XtreemFS is on techniques for efficient and fault-tolerant replication, large scale snapshots and backups as well as monitoring, automatic tuning and healing. As part of XtreemFS, we also develop BabuDB, an LSM-tree based database which is used for storing metadata in XtreemFS.

Further details:
http://www.xtreemfs.org/

XtreemFS
Group
Distributed Data Management
Members
Noack, Matthias


Related features
Fairness and Load in Distributed File Systems
Related projects
Astro VDZ
BabuDB
BBDC
BBDC WP12
Contrail
FFMK
First We Take Berlin
GeoMultiSens
Harness
MoSGrid
XtreemOS

Publications

2018
From Application to Disk: Tracing I/O Through the Big Data Stack High Performance Computing ISC High Performance 2018 International Workshops, Frankfurt/Main, Germany, June 24 - 28, 2018, Revised Selected Papers, Workshop on Performance and Scalability of Storage Systems (WOPSSS), pp. 89-102, 2018 Robert Schmidtke, Florian Schintke, Thorsten Schütt BibTeX
DOI
2017
Implementierung und Evaluation von Erasure Coding im verteilten Dateisystem XtreemFS Master's thesis, Freie Universität Berlin, Katinka Wolter, Florian Schintke (Advisors), 2017 Johannes Dillmann BibTeX
2016
Ende-zu-Ende Verschlüsselung in XtreemFS Master's thesis, Humboldt-Universität zu Berlin, Alexander Reinefeld, Jens-Peter Redlich (Advisors), 2016 Philippe Lieser BibTeX
Fast In-Memory Checkpointing with POSIX API for Legacy Exascale-Applications SPPEXA Symposium 2016, 2016 J. Fajerski, Matthias Noack, Alexander Reinefeld, Florian Schintke, Thorsten Schütt, Thomas Steinke BibTeX
DOI
Konzipierung und Implementierung eines Quota-Protokolls in objektbasierten Dateisystemen Master's thesis, Humboldt-Universität zu Berlin, Alexander Reinefeld, Ulf Leser (Advisors), 2016 Robert Bärhold BibTeX
2014
QoS-aware Storage Virtualization for Cloud File Systems Proceedings of the 1st ACM International Workshop on Programmable File Systems, pp. 19-26, PFSW '14, 2014 Christoph Kleineweber, Alexander Reinefeld, Thorsten Schütt BibTeX
DOI
2013
Consistency and Fault Tolerance of Distributed Storage Systems Doctoral thesis, Humboldt-Universität zu Berlin, 2013 Kathrin Sobe BibTeX
Consistent and Partition-Tolerant File Replication in the Cloud File System Xtreem FS Praxis der Informationsverarbeitung und Kommunikation, 36(1), p. 39, 2013 Michael Berlin BibTeX
DOI
Konsistentes Hinzufügen und Entfernen von Replikaten in XtreemFS Bachelor's thesis, Freie Universität Berlin, Florian Schintke, Katinka Wolter (Advisors), 2013 Johannes Dillmann PDF
BibTeX
URN
Leistungsanalyse von XtreemFS als Ersatz für HDFS in Hadoop Bachelor's thesis, Freie Universität Berlin, Florian Schintke, Katinka Wolter (Advisors), 2013 Lukas Kairies PDF
BibTeX
URN
Snapshots in Large-Scale Distributed File Systems Doctoral thesis, Humboldt-Universität zu Berlin, 2013 Jan Stender PDF
BibTeX
XtreemFS & Scalaris Science & Technology, pp. 54-55, 2013 Florian Schintke BibTeX
XtreemFS – a File System for the Cloud Data Intensive Storage Services for Cloud Environments, D. Kyriazis, A. Voulodimos, S. Gogouvitis, Theodora A. Varvarigou (Eds.), IGI Global, 2013 Jan Stender, Michael Berlin, Alexander Reinefeld BibTeX
DOI
2012
A fault-tolerant and scalable protocol for replication in distributed file systems Doctoral thesis, Humboldt-Universität zu Berlin, 2012 Björn Kolbeck BibTeX
Application of Regenerating Codes for Fault Tolerance in Distributed Storage Systems Network Computing and Applications (NCA), 2012 11th IEEE International Symposium on, pp. 67-70, 2012 Kathrin Peter, Peter Sobe BibTeX
DOI
Consistency and fault tolerance for erasure-coded distributed storage systems Proceedings of the fifth international workshop on Data-Intensive Distributed Computing Date, pp. 23-32, DIDC ’12, 2012 Kathrin Peter, Alexander Reinefeld BibTeX
DOI
Überlastungsschutz mit Anfragepriorisierung für das Internetdateisystem XtreemFS Master's thesis, Freie Universität Berlin, 2012 Felix Langner BibTeX
2011
Flease - Lease Coordination Without a Lock Server Parallel and Distributed Processing Symposium, International, Vol.0, pp. 978-988, 2011 Björn Kolbeck, Mikael Högqvist, Jan Stender, Felix Hupfeld BibTeX
DOI
Popularitätsbasierte Anpassung des Replikationsfaktors in verteilten Dateisystemen Master's thesis, Humboldt-Universität zu Berlin, Alexander Reinefeld (Advisor), 2011 Michael Berlin BibTeX
Reliability Study of Coding Schemes for Wide-Area Distributed Storage Systems PDP 2011: The 19th Euromicro International Conference on Parallel, Distributed and Network-Based Computing, 2011 Kathrin Peter BibTeX
DOI
2010
BabuDB: Fast and Efficient File System Metadata Storage Storage Network Architecture and Parallel I/Os, IEEE International Workshop on, pp. 51-58, 2010 Jan Stender, Björn Kolbeck, Mikael Högqvist, Felix Hupfeld BibTeX
DOI
Efficiency Considerations of Cauchy Reed-Solomon Implementations on Accelerator and Multi-Core Platforms Symposium on Application Accelerators in High Performance Computing (SAAHPC), 2010 Thomas Steinke, Kathrin Peter, Sebastian Borchert BibTeX
Fault-Tolerant and Decentralized Lease Coordination in Distributed Systems ZIB-Report 10-02 Björn Kolbeck, Mikael Högqvist, Jan Stender, Felix Hupfeld PDF
BibTeX
URN
Loosely Time-Synchronized Snapshots in Object-Based File Systems Proceedings of the 29th IEEE International Performance, Computing, and Communications Conference, 2010 Jan Stender, Mikael Högqvist, Björn Kolbeck BibTeX
DOI
2009
A Protocol for Efficient and Fault-tolerant File Replication over Wide-Area Networks TCPP Ph.D. Forum, Int. Parallel and Distributed Processing Symposium, Vol.0, p. 19, 2009 Björn Kolbeck BibTeX
DOI
Causal weak-consistency replication – a systems approach Doctoral thesis, Humboldt-Universität zu Berlin, 2009 Felix Hupfeld BibTeX
URN
Distributed Erasure Tolerant Storage with Solid State Technology TCPP Ph.D. Forum, Int. Parallel and Distributed Processing Symposium, p. 23, 2009 Kathrin Peter BibTeX
DOI
Efficient Management of Consistent Backups in a Distributed File System COMPSAC (1), pp. 656-659, 2009 Jan Stender BibTeX
DOI
Ein eingebettetes Hauptspeicher-Datenbanksystem mit Snapshot-Reads Master's thesis, Humboldt-Universität zu Berlin, Alexander Reinefeld, Jens-Peter Redlich (Advisors), 2009 Daniel Mauter PDF
BibTeX
URN
FaTLease: scalable fault-tolerant lease negotiation with Paxos Cluster Computing, 12(2), pp. 175-188, 2009 Felix Hupfeld, Björn Kolbeck, Jan Stender, Mikael Högqvist, Toni Cortes, Jonathan Martí, Jesus Malo BibTeX
DOI
Leistungsverbesserung der Datenübertragung bei der Replikation von nicht veränderlichen Dateien in einem verteilten Dateisystem Master's thesis, Technische Universität Berlin, 2009 Christian Lorenz BibTeX
2008
FaTLease: Scalable Fault-Tolerant Lease Negotiation with Paxos ACM/IEEE International Symposium on High Performance Distributed Computing (HPDC), 2008 Felix Hupfeld, Björn Kolbeck, Jan Stender, Mikael Högqvist, Toni Cortes, Jonathan Martí, Jesus Malo BibTeX
Flexible Parameterization of XOR based Codes for Distributed Storage Proceedings of The Seventh IEEE International Symposium on Networking Computing and Applications, NCA 2008, July 10-12, 2008, Cambridge, Massachusetts, USA, pp. 101-110, 2008 Peter Sobe, Kathrin Peter BibTeX
DOI
Striping without Sacrifices: Maintaining POSIX Semantics in a Parallel File System Proceedings of the 1st USENIX Workshop on Large-Scale Computing (LASCO’08), 2008 Jan Stender, Björn Kolbeck, Felix Hupfeld, Eugenio Cesario, Erich Focht, Matthias Hess, Jesus Malo, Jonathan Martí BibTeX
The XtreemFS architecture - A case for object-based file systems in Grids Concurrency and Computation: Practice and Experience, 20(8), 2008 Felix Hupfeld, Toni Cortes, Björn Kolbeck, Erich Focht, Matthias Hess, Jesus Malo, Jonathan Marti, Jan Stender, Eugenio Cesario BibTeX
2007
Combining Compression, Encryption and Fault-tolerant Coding for Distributed Storage 21th International Parallel and Distributed Processing Symposium (IPDPS 2007) Proceedings, pp. 1-8, 2007 Peter Sobe, Kathrin Peter BibTeX
XtreemFS: a case for object-based storage in Grid data management 3rd VLDB Workshop on Data Management in Grids, co-located with VLDB 2007, 2007 Felix Hupfeld, Toni Cortes, Björn Kolbeck, Jan Stender, Erich Focht, Matthias Hess, Jesus Malo, Jonathan Marti, Eugenio Cesario BibTeX
2006
Flexible Definition of Data and Redundancy Layout for Storage Systems Sixth European Dependable Computing Conference (EDCC-6), Proceedings Supplemental Volume, pp. 59-60, 2006 Kathrin Peter, Peter Sobe BibTeX
2004
Log-Structured Storage for Efficient Weakly-Connected Replication 24th International Conference on Distributed Computing Systems Workshops (ICDCS 2004 Workshops), 23-24 March 2004, Hachioji, Tokyo, Japan, pp. 458-463, 2004 Felix Hupfeld BibTeX
DOI