XtreemFS - A cloud file system
XtreemFS is a distributed and replicated file system for cloud and grid infrastructures; clients and servers can be distributed worldwide. XtreemFS builds a reliable storage system from standard off-the-shelve components through replication. The complexity of geographic distribution and replication is transparently provided as a POSIX file system. Applications and users do not see a difference in the API and semantics compared to local file systems. The research focus for XtreemFS is on techniques for efficient and fault-tolerant replication, large scale snapshots and backups as well as monitoring, automatic tuning and healing. As part of XtreemFS, we also develop BabuDB, an LSM-tree based database which is used for storing metadata in XtreemFS.
Further details:
http://www.xtreemfs.org/
Publications
2018 |
|||
Robert Schmidtke, Florian Schintke, Thorsten Schütt | From Application to Disk: Tracing I/O Through the Big Data Stack | High Performance Computing ISC High Performance 2018 International Workshops, Frankfurt/Main, Germany, June 24 - 28, 2018, Revised Selected Papers, Workshop on Performance and Scalability of Storage Systems (WOPSSS), pp. 89-102, 2018 |
BibTeX
DOI |
2017 |
|||
Johannes Dillmann | Implementierung und Evaluation von Erasure Coding im verteilten Dateisystem XtreemFS | Master's thesis, Freie Universität Berlin, Katinka Wolter, Florian Schintke (Advisors), 2017 |
BibTeX
|
2016 |
|||
Philippe Lieser | Ende-zu-Ende Verschlüsselung in XtreemFS | Master's thesis, Humboldt-Universität zu Berlin, Alexander Reinefeld, Jens-Peter Redlich (Advisors), 2016 |
BibTeX
|
J. Fajerski, Matthias Noack, Alexander Reinefeld, Florian Schintke, Thorsten Schütt, Thomas Steinke | Fast In-Memory Checkpointing with POSIX API for Legacy Exascale-Applications | SPPEXA Symposium 2016, 2016 |
BibTeX
DOI |
Robert Bärhold | Konzipierung und Implementierung eines Quota-Protokolls in objektbasierten Dateisystemen | Master's thesis, Humboldt-Universität zu Berlin, Alexander Reinefeld, Ulf Leser (Advisors), 2016 |
BibTeX
|
2014 |
|||
Christoph Kleineweber, Alexander Reinefeld, Thorsten Schütt | QoS-aware Storage Virtualization for Cloud File Systems | Proceedings of the 1st ACM International Workshop on Programmable File Systems, pp. 19-26, PFSW '14, 2014 |
BibTeX
DOI |
2013 |
|||
Kathrin Sobe | Consistency and Fault Tolerance of Distributed Storage Systems | Doctoral thesis, Humboldt-Universität zu Berlin, 2013 |
BibTeX
|
Michael Berlin | Consistent and Partition-Tolerant File Replication in the Cloud File System Xtreem FS | Praxis der Informationsverarbeitung und Kommunikation, 36(1), p. 39, 2013 |
BibTeX
DOI |
Johannes Dillmann | Konsistentes Hinzufügen und Entfernen von Replikaten in XtreemFS | Bachelor's thesis, Freie Universität Berlin, Florian Schintke, Katinka Wolter (Advisors), 2013 |
PDF
BibTeX URN |
Lukas Kairies | Leistungsanalyse von XtreemFS als Ersatz für HDFS in Hadoop | Bachelor's thesis, Freie Universität Berlin, Florian Schintke, Katinka Wolter (Advisors), 2013 |
PDF
BibTeX URN |
Jan Stender | Snapshots in Large-Scale Distributed File Systems | Doctoral thesis, Humboldt-Universität zu Berlin, 2013 |
PDF
BibTeX |
Florian Schintke | XtreemFS & Scalaris | Science & Technology, pp. 54-55, 2013 |
BibTeX
|
Jan Stender, Michael Berlin, Alexander Reinefeld | XtreemFS – a File System for the Cloud | Data Intensive Storage Services for Cloud Environments, D. Kyriazis, A. Voulodimos, S. Gogouvitis, Theodora A. Varvarigou (Eds.), IGI Global, 2013 |
BibTeX
DOI |
2012 |
|||
Björn Kolbeck | A fault-tolerant and scalable protocol for replication in distributed file systems | Doctoral thesis, Humboldt-Universität zu Berlin, 2012 |
BibTeX
|
Kathrin Peter, Peter Sobe | Application of Regenerating Codes for Fault Tolerance in Distributed Storage Systems | Network Computing and Applications (NCA), 2012 11th IEEE International Symposium on, pp. 67-70, 2012 |
BibTeX
DOI |
Kathrin Peter, Alexander Reinefeld | Consistency and fault tolerance for erasure-coded distributed storage systems | Proceedings of the fifth international workshop on Data-Intensive Distributed Computing Date, pp. 23-32, DIDC ’12, 2012 |
BibTeX
DOI |
Felix Langner | Überlastungsschutz mit Anfragepriorisierung für das Internetdateisystem XtreemFS | Master's thesis, Freie Universität Berlin, 2012 |
BibTeX
|
2011 |
|||
Björn Kolbeck, Mikael Högqvist, Jan Stender, Felix Hupfeld | Flease - Lease Coordination Without a Lock Server | Parallel and Distributed Processing Symposium, International, Vol.0, pp. 978-988, 2011 |
BibTeX
DOI |
Michael Berlin | Popularitätsbasierte Anpassung des Replikationsfaktors in verteilten Dateisystemen | Master's thesis, Humboldt-Universität zu Berlin, Alexander Reinefeld (Advisor), 2011 |
BibTeX
|
Kathrin Peter | Reliability Study of Coding Schemes for Wide-Area Distributed Storage Systems | PDP 2011: The 19th Euromicro International Conference on Parallel, Distributed and Network-Based Computing, 2011 |
BibTeX
DOI |
2010 |
|||
Jan Stender, Björn Kolbeck, Mikael Högqvist, Felix Hupfeld | BabuDB: Fast and Efficient File System Metadata Storage | Storage Network Architecture and Parallel I/Os, IEEE International Workshop on, pp. 51-58, 2010 |
BibTeX
DOI |
Thomas Steinke, Kathrin Peter, Sebastian Borchert | Efficiency Considerations of Cauchy Reed-Solomon Implementations on Accelerator and Multi-Core Platforms | Symposium on Application Accelerators in High Performance Computing (SAAHPC), 2010 |
BibTeX
|
Björn Kolbeck, Mikael Högqvist, Jan Stender, Felix Hupfeld | Fault-Tolerant and Decentralized Lease Coordination in Distributed Systems | ZIB-Report 10-02 |
PDF
BibTeX URN |
Jan Stender, Mikael Högqvist, Björn Kolbeck | Loosely Time-Synchronized Snapshots in Object-Based File Systems | Proceedings of the 29th IEEE International Performance, Computing, and Communications Conference, 2010 |
BibTeX
DOI |
2009 |
|||
Björn Kolbeck | A Protocol for Efficient and Fault-tolerant File Replication over Wide-Area Networks | TCPP Ph.D. Forum, Int. Parallel and Distributed Processing Symposium, Vol.0, p. 19, 2009 |
BibTeX
DOI |
Felix Hupfeld | Causal weak-consistency replication – a systems approach | Doctoral thesis, Humboldt-Universität zu Berlin, 2009 |
BibTeX
URN |
Kathrin Peter | Distributed Erasure Tolerant Storage with Solid State Technology | TCPP Ph.D. Forum, Int. Parallel and Distributed Processing Symposium, p. 23, 2009 |
BibTeX
DOI |
Jan Stender | Efficient Management of Consistent Backups in a Distributed File System | COMPSAC (1), pp. 656-659, 2009 |
BibTeX
DOI |
Daniel Mauter | Ein eingebettetes Hauptspeicher-Datenbanksystem mit Snapshot-Reads | Master's thesis, Humboldt-Universität zu Berlin, Alexander Reinefeld, Jens-Peter Redlich (Advisors), 2009 |
PDF
BibTeX URN |
Felix Hupfeld, Björn Kolbeck, Jan Stender, Mikael Högqvist, Toni Cortes, Jonathan Martí, Jesus Malo | FaTLease: scalable fault-tolerant lease negotiation with Paxos | Cluster Computing, 12(2), pp. 175-188, 2009 |
BibTeX
DOI |
Christian Lorenz | Leistungsverbesserung der Datenübertragung bei der Replikation von nicht veränderlichen Dateien in einem verteilten Dateisystem | Master's thesis, Technische Universität Berlin, 2009 |
BibTeX
|
2008 |
|||
Felix Hupfeld, Björn Kolbeck, Jan Stender, Mikael Högqvist, Toni Cortes, Jonathan Martí, Jesus Malo | FaTLease: Scalable Fault-Tolerant Lease Negotiation with Paxos | ACM/IEEE International Symposium on High Performance Distributed Computing (HPDC), 2008 |
BibTeX
|
Peter Sobe, Kathrin Peter | Flexible Parameterization of XOR based Codes for Distributed Storage | Proceedings of The Seventh IEEE International Symposium on Networking Computing and Applications, NCA 2008, July 10-12, 2008, Cambridge, Massachusetts, USA, pp. 101-110, 2008 |
BibTeX
DOI |
Jan Stender, Björn Kolbeck, Felix Hupfeld, Eugenio Cesario, Erich Focht, Matthias Hess, Jesus Malo, Jonathan Martí | Striping without Sacrifices: Maintaining POSIX Semantics in a Parallel File System | Proceedings of the 1st USENIX Workshop on Large-Scale Computing (LASCO’08), 2008 |
BibTeX
|
Felix Hupfeld, Toni Cortes, Björn Kolbeck, Erich Focht, Matthias Hess, Jesus Malo, Jonathan Marti, Jan Stender, Eugenio Cesario | The XtreemFS architecture - A case for object-based file systems in Grids | Concurrency and Computation: Practice and Experience, 20(8), 2008 |
BibTeX
|
2007 |
|||
Peter Sobe, Kathrin Peter | Combining Compression, Encryption and Fault-tolerant Coding for Distributed Storage | 21th International Parallel and Distributed Processing Symposium (IPDPS 2007) Proceedings, pp. 1-8, 2007 |
BibTeX
|
Felix Hupfeld, Toni Cortes, Björn Kolbeck, Jan Stender, Erich Focht, Matthias Hess, Jesus Malo, Jonathan Marti, Eugenio Cesario | XtreemFS: a case for object-based storage in Grid data management | 3rd VLDB Workshop on Data Management in Grids, co-located with VLDB 2007, 2007 |
BibTeX
|
2006 |
|||
Kathrin Peter, Peter Sobe | Flexible Definition of Data and Redundancy Layout for Storage Systems | Sixth European Dependable Computing Conference (EDCC-6), Proceedings Supplemental Volume, pp. 59-60, 2006 |
BibTeX
|
2004 |
|||
Felix Hupfeld | Log-Structured Storage for Efficient Weakly-Connected Replication | 24th International Conference on Distributed Computing Systems Workshops (ICDCS 2004 Workshops), 23-24 March 2004, Hachioji, Tokyo, Japan, pp. 458-463, 2004 |
BibTeX
DOI |