Issues

• Petastorm not working due to PyArrow version hell

  uber/petastorm#806 · Filter by author kiranzo opened on Aug 27, 2024
  4

• Petastorm break with pyarrow 13.0 or newer. Stable version of pyarrow is at 16.0 now.

  uber/petastorm#805 · Filter by author LauritsDixen opened on May 1, 2024
  2

• Petastorm hangs forever in DataBricks

  uber/petastorm#804 · Filter by author juzzmac opened on Feb 20, 2024
  1

• ParquetDataset has an invalid parameter validate_schema

  uber/petastorm#803 · Filter by author karnawhat opened on Jan 29, 2024
  1

• FutureWarning: 'ParquetDataset.partitions' attribute is deprecated as of pyarrow 5.0.0 and will be removed in a future version.

  uber/petastorm#800 · Filter by author ton11111 opened on Oct 6, 2023
  1

• Bug in ConcurrentVentilator._ventilate() when randomize_item_order=True and random seed is fixed

  uber/petastorm#798 · Filter by author JonasRauch opened on Jul 31, 2023

• Issue with loading nested array type from spark DF to torch

  uber/petastorm#797 · Filter by author sardinois opened on Jun 7, 2023

• String as input in petastorm dataloaders

  uber/petastorm#795 · Filter by author freud14-tm opened on May 10, 2023
  3

• Seeing worse model performance from using petastorm vs normal pytorch dataloader

  uber/petastorm#793 · Filter by author AKhazane opened on Mar 18, 2023
  1

• TypeError: __init__() missing 2 required positional arguments: 'instance' and 'token'

  uber/petastorm#790 · Filter by author devVipin01 opened on Feb 23, 2023

• AttributeError: 'bool' object has no attribute 'map' ​while using Predicate

  uber/petastorm#789 · Filter by author littlehomelessman opened on Jan 19, 2023

• How to transform the string data to numerical when using make_batch_reader?

  uber/petastorm#788 · Filter by author littlehomelessman opened on Jan 17, 2023

• make_batch_reader Documentation out of date? seed?

  uber/petastorm#786 · Filter by author Data-drone opened on Dec 22, 2022

• Petastorm sharding and setting batch sizes

  uber/petastorm#785 · Filter by author Data-drone opened on Dec 22, 2022

• when hdfs-site.xml file has xi:include tag, the function cann't get hadoop_configuration info

  uber/petastorm#782 · Filter by author lytk01 opened on Oct 27, 2022

• Random seed doesn't seem to work well

  uber/petastorm#779 · Filter by author kisel4363 opened on Sep 23, 2022
  2

• using SHAP with petastorm dataset

  uber/petastorm#776 · Filter by author sdaza opened on Sep 9, 2022
  1

• Dynamic shape of lables.

  uber/petastorm#774 · Filter by author ohindialign opened on Sep 7, 2022
  3

• in_set predicate raises error unhashable type: 'Series'

  uber/petastorm#773 · Filter by author Joachim-Sh opened on Sep 5, 2022

• weighted_sampling_reader

  uber/petastorm#770 · Filter by author weidezhang opened on Aug 19, 2022
  3

• make_spark_converter RuntimeError: Vector columns are only supported in pyspark>=3.0

  uber/petastorm#769 · Filter by author Alxe1 opened on Aug 18, 2022
  4

• null cache

  uber/petastorm#768 · Filter by author weidezhang opened on Aug 16, 2022
  4

• make_batch_reader loses dtype with list-of-strings columns, causing Tensorflow error when lists contain a None value

  uber/petastorm#765 · Filter by author arhan-gunel opened on Jul 25, 2022

• dynamic padding via collate_fn

  uber/petastorm#761 · Filter by author Jomonsugi opened on Jul 12, 2022
  11

• Can we input a custom collate function as an input variable when creating the dataloader ?

  uber/petastorm#759 · Filter by author shamanez opened on Jul 7, 2022