Shorties

• list all options: pd.describe_option()
• set display width: pd.set_option('display.width', 200)
• set max column width: pd.set_option('display.max_colwidth', 100) (default=50)
• run a script within IPython's namespace: %run -i yourscript.py

Load a script in the spark-shell

Within spark shell:

:load yourcode.scala

On the CLI:

spark-shell -i yourcode.scala

or:

cat yourcode.scala | spark-shell

History

:history