o ¹­§i#ã@sºddlmZddlZddlmZmZmZddlmZm Z ddl m Z ddl m Z ddlmZer#súüÿz*_simple_json_normalize..)Ú isinstanceÚdictÚ_normalize_json_orderedÚlist)r rrrZnormalized_json_objectZnormalized_json_listrrrrs" ü õù rrÚ key_stringÚnormalized_dictúdict[str, Any]c Csˆt|tƒr>|dkr6|r|›|›nd}|d}| ¡D]\}} |r'|›|›n|} t| | ||||dq|S||ƒ||<|S|||<|S)a  Main recursive function. Designed for the most basic use case of `pl.json_normalize(data)`, intended as a performance improvement. Parameters ---------- data : Any Type dependent on types contained within nested Json key_string : str New key (with separator(s) in) for data normalized_dict : dict The new normalized/flattened Json dict separator : str, default '.' Nested records will generate names separated by sep, e.g., for sep='.', { 'foo' : { 'bar' : 0 } } -> foo.bar max_level recursion depth encoder Custom JSON encoder; if not given, `json.dumps` is used. rÚé©r r"r#rrr)rrÚitemsÚ_normalize_json) r r"r#rrrZkey_rootZnested_max_levelÚkeyÚvalueZnew_keyrrrr)2s& ú ür)c CsXii}}| ¡D]\}}t|tƒr|||<q |||<q t|di|||d}i|¥|¥S)a Order the top level keys and then recursively go to depth. Parameters ---------- data Deserialized JSON objects (dict or list of dicts) separator Nested records will generate names separated by sep. e.g., for `separator=".", {"foo": {"bar": 0}}` -> foo.bar. max_level Max number of levels(depth of dict) to normalize. encoder Custom JSON encoder; if not given, `json.dumps` is used. Returns ------- dict or list of dicts, matching `normalized_json_object` r%r')r(rrr)) r rrrZtop_Z nested_dataÚkÚvZnested_rrrr gs    ú r Ú.T)rrÚschemaÚstrictÚinfer_schema_lengthrú int | Noner/ú Schema | Noner0Úboolr1úJSONEncoder | Noner cCsš|durd}|d7}t|tƒrt|ƒdkrt|dSt|tƒr#|g}nt|tƒr2t|tƒs2t|ƒ}nd}t|ƒ‚|dur?t j }tt ||||d|||dS) uš Normalize semi-structured deserialized JSON data into a flat table. Dictionary objects that will not be unnested/normalized are encoded as json string data. Unlike it pandas' counterpart, this function will not encode dictionaries as objects at any level. .. warning:: This functionality is considered **unstable**. It may be changed at any point without it being considered a breaking change. Parameters ---------- data Deserialized JSON objects. separator Nested records will generate names separated by sep. e.g., for `separator=".", {"foo": {"bar": 0}}` -> foo.bar. max_level Max number of levels(depth of dict) to normalize. If None, normalizes all levels. schema Overwrite the `Schema` when the normalized data is passed to the `DataFrame` constructor. strict Whether Polars should be strict when constructing the DataFrame. infer_schema_length Number of rows to take into consideration to determine the schema. encoder Custom JSON encoder function; if not given, `json.dumps` is used. Examples -------- >>> data = [ ... { ... "id": 1, ... "name": "Cole Volk", ... "fitness": {"height": 180, "weight": 85}, ... }, ... { ... "id": 2, ... "name": "Faye Raker", ... "fitness": {"height": 155, "weight": 58}, ... }, ... { ... "name": "Mark Reg", ... "fitness": {"height": 170, "weight": 78}, ... }, ... ] >>> pl.json_normalize(data, max_level=1) shape: (3, 4) ┌──────┬────────────┬────────────────┬────────────────┠│ id ┆ name ┆ fitness.height ┆ fitness.weight │ │ --- ┆ --- ┆ --- ┆ --- │ │ i64 ┆ str ┆ i64 ┆ i64 │ â•žâ•â•â•â•â•â•â•ªâ•â•â•â•â•â•â•â•â•â•â•â•â•ªâ•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•ªâ•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•¡ │ 1 ┆ Cole Volk ┆ 180 ┆ 85 │ │ 2 ┆ Faye Raker ┆ 155 ┆ 58 │ │ null ┆ Mark Reg ┆ 170 ┆ 78 │ └──────┴────────────┴────────────────┴────────────────┘ Normalize to a specific depth, using a custom JSON encoder (note that `orson.dumps` encodes to bytes, not str). >>> import orjson >>> pl.json_normalize(data, max_level=0, encoder=orjson.dumps) shape: (3, 3) ┌──────┬────────────┬───────────────────────────────┠│ id ┆ name ┆ fitness │ │ --- ┆ --- ┆ --- │ │ i64 ┆ str ┆ binary │ â•žâ•â•â•â•â•â•â•ªâ•â•â•â•â•â•â•â•â•â•â•â•â•ªâ•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•¡ │ 1 ┆ Cole Volk ┆ b"{"height":180,"weight":85}" │ │ 2 ┆ Faye Raker ┆ b"{"height":155,"weight":58}" │ │ null ┆ Mark Reg ┆ b"{"height":170,"weight":78}" │ └──────┴────────────┴───────────────────────────────┘ Nlr&r)r/z expected list or dict of objectsr)r/r0r1) rrÚlenr rrrr!Ú ValueErrorÚjsonÚdumpsr)r rrr/r0r1rÚmsgrrrÚjson_normalize’s0X   ü÷r;) r rrrrrrr rr)r rr"rr#r$rrrrrr rr$) r r$rrrrrr rr$)r rrrrr2r/r3r0r4r1r2rr5rr )Ú __future__rr8Úcollections.abcrrrÚtypingrrZpolars._utils.unstablerZpolars.dataframer Zpolars.datatypes.constantsr Zpolars._typingr Z polars.schemar rr)r r;rrrrÚs*        5+ø