Skip to content

Commit

Permalink
Merge pull request #111 from jeffbrennan/main
Browse files Browse the repository at this point in the history
document show_output_to_df()
  • Loading branch information
SemyonSinchenko authored Aug 31, 2023
2 parents b6b4f70 + c23c458 commit 54a8236
Showing 1 changed file with 18 additions and 0 deletions.
18 changes: 18 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -261,6 +261,24 @@ quinn.to_list_of_dictionaries(source_df)

Converts an entire DataFrame into a list of dictionaries.

**show_output_to_df()**

```python
quinn.show_output_to_df(output_str, spark)
```

Parses a spark DataFrame output string into a spark DataFrame. Useful for quickly pulling data from a log into a DataFrame. In this example, output_str is a string of the form:

```
+----+---+-----------+------+
|name|age| stuff1|stuff2|
+----+---+-----------+------+
|jose| 1|nice person| yoyo|
| li| 2|nice person| yoyo|
| liz| 3|nice person| yoyo|
+----+---+-----------+------+
```

## Pyspark Core Class Extensions

```
Expand Down

0 comments on commit 54a8236

Please sign in to comment.