Meeting 1

Mon, 01 Jan 0001 00:00:00 +0000

Information#

Date: Monday, September 26th 11AM - 12PM Pacific time (click for your timezone)
Zoom Link (sign in required): https://berkeley.zoom.us/j/96628687450?pwd=Q29oeDc5NnJEYlFHVU1yVUFITzNQUT09

Participants#

Hameer Abbasi
Nezar Abdennur
Ross Barnowski
CJ Carey
Jérémie du Boisberranger
Julien Jerphanion
Jim Kitchen
Jarrod Millman
Dan Schult
Stéfan van der Walt
Isaac Virshup
Erik Welch
Meekail Zain

Agenda#

The summit is scheduled for 1 hour and will consist of a series of high-level birds-of-a-feather (BoF)-style talks, followed by more focused discussion.

Meeting 2

Mon, 01 Jan 0001 00:00:00 +0000

Information#

Date: Thursday, April 27th 11AM - 12PM Pacific time (click for your timezone)
Zoom Link: https://ucsc.zoom.us/j/93937164560?pwd=UmZKTmlHeGRMRkN3a2h2SDNJY3lvZz09

Participants#

Agenda#

The summit is scheduled for 1 hour and will focus on the proposed array semantics in scipy.sparse (download) and what work can be accomplished during the 2023 Scientific Python developer summit.

(5 min) Welcome & Introductions (Jarrod Millman)
(50 min) Discussion
- Who will be working on scipy sparse arrays during the summit?

Summit Follow Up June 17

Mon, 01 Jan 0001 00:00:00 +0000

Friday June 17 2023, 14:00 to 15:00 UTC#

Attendees#

Dan
Erik
Isaac
CJ
Julien

Agenda#

Sort out and attribute what remains to be done
Roadmap/ plan for array-like sparse arrays
- Deprecation plan for matrices
- Creation routines
- Interop with other sparse matrix packages (isaac)
Blog post

Notes#

Introduction, Erik works on libraries using sparse datastructures
- [Julien] Erik: here is the worklog of the summit

What remains to be done#

How do we work
- [Dan] Where does in-progress work go
  - CJ’s fork, make PRs onto branch there
  - Using the view on the diff on GitHub might prevent the creation of spurious Draft PR
- Dense pretending to be sparse can be ephermeral, never needs to go to scipy
- Dan will make a branch for exploration that people can fork and make PRs to. Dan will try to keep it up-to-date with the main branch too.
1d sparse array support Timeline? - Dan + CJ working on it - Targeting 1.12
nd sparse array support
- Julien, CJ: seems like low priority and this would be a huge maintenance cost SciPy for relatively rare use-cases
- CJ: Array api makes interop easier, we can lean on external packages for now
creation functions scipy#18592
- Want to get them out in a single release
- Is Ross going to implement these, or need to assign elsewhere?
- Current plan: _array methods, so we can apply this to the fast_matrix_market io at the same type
- Bundling in api changes (like tuples for shapes)
Deprecate isspmatrix_ methods?
- Sounds like combination of classes + format attribute cover this
- (Julien) Deprecation plan: have suggested code to replace these things with
- Add a section in the documentation explaining the change of semantic and a migration plan for downstream libraries during the deprecation cycle.
  - Make a roadmap for array api
scikit-learn
- When will scikit-learn be willing to support a compatible version of scipy?
  - Julien:
    - reasoning is based on some linux package manager not supporting latest numpy scipy
    - Personally would like scikit-learn to follow SPEC 0
    - See discussion for 1.3
    - Dedicated RFC
    - Some part of scikit-learn’s behavior depends on SciPy’s version (e.g. see this one); we might potentially rely on similar mechanism for the support of sparse arrays (e.g. reshaping outputs)
    - scikit-learn uses nightly builds to test the developer version of SciPy and NumPy and failing tests are updated in this issue. We can watch those for breakage in scikit-learn when we make changes in SciPy.
General speed ups
- “Fast path for canonical”
  - TODO (Isaac)
    - Figure out canonical for all the formats, probably normalize APIs
    - Add keyword public argument for constructors

Broad plan for deprecation#

Add support for sparse_arrays everywhere we can
- Creation functions: target 1.12
- 1d COO: target 1.12
Deprecate spmatrix-specific functions (where there’s an easy replacement)
- Target: 1.12
Once everything works with sparse arrays, then deprecate spmatrix
- And the sparse array API is stable! (specifically, 1d support)
- Target: 1.13

Actionable items#

[Julien] Add a section in the documentation explaining the change of semantic and a migration plan for downstream libraries during the deprecation cycle.
[Julien] Drop isspmatrix_- checks in scikit-learn and use issparse and format

Next meeting date and time#

Every two weeks with the option to drop every other meeting (at least once a month)

[name=Julien] +1. I proposed to meet every two week for 1h on the same timeslot

Sparse Data on Scientific Python

Meeting 1

Information#

Participants#

Agenda#

Meeting 2

Information#

Participants#

Agenda#

Summit Follow Up June 17

Friday June 17 2023, 14:00 to 15:00 UTC#

Attendees#

Agenda#

Notes#

What remains to be done#

Broad plan for deprecation#

Actionable items#

Next meeting date and time#