pyspark-ai/pyspark-ai

Issues

• Convert prompt.py into multiple files as per the target API

  #113 opened a year ago by gengliangwang
  6

• Fix project dependencies

  #137 opened 7 months ago by MrPowers
  2

• [Proposal] testing against both SparkSession and SparkConnect Session

  #194 opened 7 months ago by SemyonSinchenko
  1

• Move all spark related methods to a new class SparkUtils

  #108 opened 7 months ago by gengliangwang
  2

• Build API Documentations

  #83 opened a year ago by gengliangwang
  9

• [Proposal] Add example notebooks as pages to documentation

  #142 opened 7 months ago by SemyonSinchenko
  2

• Am exploring Pyspark AI ValidationError: 1 validation error for PythonExecutor df instance of DataFrame expected (type=type_error.arbitrary_type; expected_arbitrary_type=DataFrame)

  #192 opened 10 months ago by saikumarveera
  7

• [Proposal] Issues template

  #193 opened 10 months ago by SemyonSinchenko
  0

• Project maintenance and further plans of development?

  #190 opened 10 months ago by SemyonSinchenko
  1

• The Spark job failed due to a Python worker crashing unexpectedly. The root cause is likely a java.io.EOFException, indicating an unexpected end of file or communication issue.

  #189 opened a year ago by sohelaafaq
  1

• Bug: "cannot import name 'Row' from 'sqlalchemy'" caused by import of old Langchain package version

  #186 opened a year ago by Gghaibeh
  3

• Create a join method

  #185 opened a year ago by ericfeunekes
  1

• Error while using ChatGooglePalm

  #57 opened a year ago by kannankvsp
  2

• Remove the prompt about similar_value if vector search is disabled

  #170 opened a year ago by gengliangwang
  0

• Resolve deprecated warnings from langchain

  #167 opened a year ago by gengliangwang
  1

• Create a new example notebook for using vector search

  #164 opened a year ago by gengliangwang
  1

• Temp View Generation does not properly work with Spark Connect

  #75 opened a year ago by grundprinzip
  4

• df.ai.plot(): Regenerate python code if the generated python code can't be evaluated

  #110 opened a year ago by gengliangwang
  0

• Change the return type of `df.ai.verify` from None to bool

  #152 opened a year ago by gengliangwang
  2

• Introduce new example for UDF generation

  #111 opened a year ago by gengliangwang
  3

• Loading DataFrame from a saved source

  #49 opened a year ago by simonson-jack
  3

• Dataframe from webpage doesn't load entire table

  #121 opened a year ago by emlyn
  1

• Switch from flake8 to ruff for linting

  #138 opened a year ago by MrPowers
  0

• Add end-to-end test for UDF generation

  #112 opened a year ago by gengliangwang
  6

• Demo code has error in DBR 13.2

  #118 opened a year ago by zhangabner
  3

• TypeError: can only concatenate str (not "NoneType") to str when trying to execute sparkai in databricks

  #127 opened a year ago by FrancescoRettondini
  1

• Support robust code generation with Code Llama

  #120 opened a year ago by gengliangwang
  1

• Add example notebook with Code Llama

  #109 opened a year ago by gengliangwang
  0

• Could not parse LLM output when using GPT3.5-turbo

  #105 opened a year ago by s4saurabh
  1

• Unable to instantiate pyspark_ai on cloud.databricks.com

  #51 opened a year ago by gkovaig
  13

• Table name as parameter for function create_df()

  #62 opened a year ago by neox2811
  2

• VertexAI - Error: NameError("name 'spark' is not defined")

  #97 opened a year ago by chuyasturiano
  0

• Upgrade langchain

  #89 opened a year ago by bjornjorgensen
  0

• Rate Limit Reached Error

  #72 opened a year ago by williamdphillips
  2

• Setup github action

  #69 opened a year ago by Pranavchiku
  1

• How I can use this to connect Azure deployed private OpenAI model?

  #68 opened a year ago by deeprpatel2
  2

• Can you retrieve the SQL query?

  #66 opened a year ago by waddahAldrobi
  2

• Using PySpark code instead of SQL

  #56 opened a year ago by grundprinzip
  4

• Error in executing spark_ai.activate().. please help

  #63 opened a year ago by FahimMohd
  8

• Facing when trying to import SparkAI from pyspark

  #45 opened a year ago by shanmugavel04
  4

• Can pyspark-ai interact with opensource LLM models

  #59 opened a year ago by marcelcastrobr
  4

• [openai.error.InvalidRequestError]: The model: `gpt-4` does not exist

  #65 opened a year ago by Pranavchiku
  2

• Uses GPT-4 by default, which may be unavailable

  #46 opened a year ago by eduardofv
  5

• Add an option to pass the model name as string

  #52 opened a year ago by BelgiAmir
  1

• Bug Report: Cannont import library after pip install

  #48 opened a year ago by LawRachel
  2

• Signed cache

  #37 opened a year ago by mengxr
  0