deepr.io.HDFSFileSystem

class deepr.io.HDFSFileSystem[source]

Context aware HDFSFileSystem using pyarrow.hdfs.

Open and closes connection to HDFS thanks to a context manager

>>> from deepr.io import HDFSFileSystem
>>> with HDFSFileSystem() as fs:  
...     fs.open("path/to/file")  
__init__()[source]

Methods

__init__()