o i @s&ddlmZddlZddlmZmZmZddlmZddl m Z ddl m Z ddl mZddlmZeedd lmZWdn1sHwYermdd lmZdd lmZdd lmZdd lmZddlmZedddddddddd+d&d'Zedddddddddd,d)d*Z dS)-) annotationsN)IO TYPE_CHECKINGLiteral)unstable)wrap_ldf) get_sources)!_init_credential_provider_builder) ScanOptions) PyLazyFrame)Path)StorageOptionsDict) DataFrame)CredentialProviderFunction) LazyFramelinesTautonamen_rowsrow_index_namerow_index_offsetglobstorage_optionscredential_providerinclude_file_pathssourcecstr | Path | IO[str] | IO[bytes] | bytes | list[str] | list[Path] | list[IO[str]] | list[IO[bytes]]rstrr int | Noner str | NonerintrboolrStorageOptionsDict | Noner3CredentialProviderFunction | Literal['auto'] | Nonerreturnrc Cst|||||||||d S)uh Read lines into a string column from a file. .. warning:: This functionality is considered **unstable**. It may be changed at any point without it being considered a breaking change. Parameters ---------- source Path(s) to a file or directory When needing to authenticate for scanning cloud locations, see the `storage_options` parameter. name Name to use for the output column. n_rows Stop reading from parquet file after reading `n_rows`. row_index_name If not None, this will insert a row index column with the given name into the DataFrame row_index_offset Offset to start the row index column (only used if the name is set) glob Expand path given via globbing rules. storage_options Options that indicate how to connect to a cloud provider. The cloud providers currently supported are AWS, GCP, and Azure. See supported keys here: * `aws `_ * `gcp `_ * `azure `_ * Hugging Face (`hf://`): Accepts an API key under the `token` parameter: \ `{'token': '...'}`, or by setting the `HF_TOKEN` environment variable. If `storage_options` is not provided, Polars will try to infer the information from environment variables. credential_provider Provide a function that can be called to provide cloud storage credentials. The function is expected to return a dictionary of credential keys along with an optional credential expiry time. .. warning:: This functionality is considered **unstable**. It may be changed at any point without it being considered a breaking change. include_file_paths Include the path of the source file(s) as a column with this name. See Also -------- scan_lines Examples -------- >>> pl.read_lines(b"Hello\nworld") shape: (2, 1) ┌───────┐ │ lines │ │ --- │ │ str │ ╞═══════╡ │ Hello │ │ world │ └───────┘ r) scan_linesZcollect) rrrrrrrrrr'F/home/app/Keep/.python/lib/python3.10/site-packages/polars/io/lines.py read_linessY r)rc Cs`t|} t|| |d} ~tj| t|dur||fnd|dur!d|fnd|||| d|d} t| S)u Construct a LazyFrame which scans lines into a string column from a file. .. warning:: This functionality is considered **unstable**. It may be changed at any point without it being considered a breaking change. Parameters ---------- source Path(s) to a file or directory When needing to authenticate for scanning cloud locations, see the `storage_options` parameter. name Name to use for the output column. n_rows Stop reading from parquet file after reading `n_rows`. row_index_name If not None, this will insert a row index column with the given name into the DataFrame row_index_offset Offset to start the row index column (only used if the name is set) glob Expand path given via globbing rules. storage_options Options that indicate how to connect to a cloud provider. The cloud providers currently supported are AWS, GCP, and Azure. See supported keys here: * `aws `_ * `gcp `_ * `azure `_ * Hugging Face (`hf://`): Accepts an API key under the `token` parameter: \ `{'token': '...'}`, or by setting the `HF_TOKEN` environment variable. If `storage_options` is not provided, Polars will try to infer the information from environment variables. credential_provider Provide a function that can be called to provide cloud storage credentials. The function is expected to return a dictionary of credential keys along with an optional credential expiry time. .. warning:: This functionality is considered **unstable**. It may be changed at any point without it being considered a breaking change. include_file_paths Include the path of the source file(s) as a column with this name. See Also -------- read_lines Examples -------- >>> pl.scan_lines(b"Hello\nworld").collect() shape: (2, 1) ┌───────┐ │ lines │ │ --- │ │ str │ ╞═══════╡ │ Hello │ │ world │ └───────┘ r&Nr)Z row_indexZ pre_slicerrrr)sourcesZ scan_optionsr)rr r Znew_from_scan_linesr r) rrrrrrrrrr*Zcredential_provider_builderZpylfr'r'r(r&s(Y r&)rrrrrrrr rr!rr"rr#rr$rr r%r)rrrrrrrr rr!rr"rr#rr$rr r%r)! __future__r contextlibtypingrrrZpolars._utils.unstablerZpolars._utils.wraprZpolars.io._utilsrZ,polars.io.cloud.credential_provider._builderr Zpolars.io.scan_options._optionsr suppress ImportErrorZ polars._plrr pathlibr Zpolars._typingr Zpolars.dataframe.framerZpolars.io.cloudrZpolars.lazyframe.framerr)r&r'r'r'r(sJ            e