Redux refactor (#1571)

* refactor categorical controls state * lint * fix race condition in tests * fix typo * add missing update on subset * remove obsolete code * update jest and puppeteer major version; update all minors * update when label changes * remove lint from tests; increase timeouts in e2e tests * initial refactoring to new async annomatrix * refine error handling * fix bad merge * add continuous legend * lint * fix memoization in color table creators * partial implementation of user defined annotations * add new annotations action creator file * first pass at user annotations * additional user annotation bug fixes * user annotation auto-save * unit test cleanup * lint * refactor into multiple files * cleanup * add column GC * fix several bugs in user annotations * remove debug code * no anonymous functions * undo redo cleanup * file cleanup * scatterplot * performance * cleanup * remove old code * render in parallel with load * fix race condition * simply graph rendering * render throttle DRY * fix category label order * fix typo in e2e test setup * re-fix the e2e test setup * be more tolerant of races * anno matrix unit tests * temp disable reembedding * pilot port continuous histo to react-async * name change * lint * fix repaint bug * typo fix * update snap to match new ids * world/universe name cleanup * move annoMatrix to src dir * use private underscore naming convention * fix corner case in all selected * name cleanup * add layout control * init edge case * lint * port scatterplot * fix label indexing bug and improve tests * port category to react-async * fix user annotation labelling while subset * select all of prev layout on layout switch * fix race with crossfilter update * prettier lint * fix misleading comment * fix url composition in loader * first pass at crossfilter tests * lint * lint * fix typo * improved error handling for network errors * fix memoization bug * add memo * refactor for performnce * add missing single-value handling in select exact parser * small bugs discovered by tests * lint * additional crossfilter unit tests * remove extraneous comment * add support for automatic category determination * lint * fix render bug in category * take advantage of schema categories guarantee * lint * do not clear history when resetting * enhanced annomatrix gc * lint * finish renaming to follow conventions; fix clone race bug * lint * add priority based loading to improve initial data load UX * crossfilter cache perf * perf tuning * remove timers * documentation * PR review changes * PR review changes * more PR review edits * improve clarity of comment * more PR review fixes * port centroidLabels to use react-async * remove dead code * pr review updates * oops, remove logging
2026-10-02 18:58:12 +08:00 · 2020-07-14 13:53:33 -07:00
parent f69d141336
commit 1269e188be
95 changed files with 18051 additions and 5382 deletions
@@ -0,0 +1,66 @@
+/*
+Garbage collection / cache management support
+
+Middleware that knows how to pull annoMatrix from the undoable state,
+and pass it along to the AnnoMatrix class for possible cache GC.
+
+Private interface.
+
+Future work item: this middleware knows internal details of both the
+Undoable metareducer and the AnnoMatrix private API.  It would be helpful
+to make the Undoable interface better factored.
+*/
+
+const annoMatrixGC = (store) => (next) => (action) => {
+  if (_itIsTimeForGC()) {
+    _doGC(store);
+  }
+  return next(action);
+};
+
+let lastGCTime = 0;
+const InterGCDelayMS = 30 * 1000; // 30 seconds
+function _itIsTimeForGC() {
+  /*
+  we don't want to run GC on every dispatch, so throttle it a bit.
+
+  Runs every InterGCDelay period
+  */
+  const now = Date.now();
+  if (now - lastGCTime > InterGCDelayMS) {
+    lastGCTime = now;
+    return true;
+  }
+  return false;
+}
+
+function _doGC(store) {
+  const state = store.getState();
+
+  // these should probably be a function imported from undoable.js, etc, as
+  // they have overly intimiate knowledge of our reducers.
+  const undoablePast = state["@@undoable/past"];
+  const undoableFuture = state["@@undoable/future"];
+  const undoableStack = undoablePast
+    .concat(undoableFuture)
+    .flatMap((snapshot) =>
+      snapshot.filter((v) => v[0] === "annoMatrix").map((v) => v[1])
+    );
+  const currentAnnoMatrix = state.annoMatrix;
+
+  /*
+  We want to identify those matrixes currently "hot", ie, linked from the current annoMatrix,
+  as our current gc algo is more aggressive with those not hot.
+  */
+  const allAnnoMatrices = new Map(
+    undoableStack.map((m) => [m, { isHot: false }])
+  );
+  let am = currentAnnoMatrix;
+  while (am) {
+    allAnnoMatrices.set(am, { isHot: true });
+    am = am.viewOf;
+  }
+  allAnnoMatrices.forEach((hints, annoMatrix) => annoMatrix._gc(hints));
+}
+
+export default annoMatrixGC;