feat(berlinmod): streaming benchmark + regenerate the MeosOps facades from master-tracked JMEOS#31
Merged
Ar-mie merged 3 commits intoJul 9, 2026
Conversation
This was referenced Jun 11, 2026
Closed
Closed
Closed
Closed
Closed
Closed
Closed
estebanzimanyi
force-pushed
the
consolidate/flink-meos-integration
branch
from
June 11, 2026 18:04
6d06a5f to
db2e51b
Compare
estebanzimanyi
force-pushed
the
consolidate/flink-benchmark
branch
3 times, most recently
from
June 14, 2026 21:10
5051555 to
7de1706
Compare
estebanzimanyi
force-pushed
the
consolidate/flink-benchmark
branch
from
June 22, 2026 23:57
03f2755 to
5697d6d
Compare
estebanzimanyi
added a commit
to estebanzimanyi/MobilityFlink
that referenced
this pull request
Jun 25, 2026
Add tools/pin/compose-order.txt (the canonical fold manifest; MobilityDB#30 merged, MobilityDB#31 carries the facade generator + benchmark) and GENERATION.md (the per-binding generator policy: MobilityFlink binds the JMEOS jar and generates the org.mobilitydb.meos facades via tools/codegen_facades.py).
Collaborator
…inMOD corpus Adds the BerlinMOD streaming benchmark harness (BerlinMODBenchmark, per Q-form throughput over the DataStream topology), the benchmark-results document, and the Kafka producer script for feeding the corpus. The benchmark runs on the canonical BerlinMOD corpus only (--csv berlinmod_instants.csv); the invented synthetic fallback is gone.
… jar + libmeos from MobilityDB master Generate the org.mobilitydb.meos.MeosOps* streaming facades from the bundled JMEOS jar via tools/codegen_facades.py, recover MeosSetSetJoin as source, and vendor the JMEOS.jar + libmeos.so built from the current MobilityDB master surface (MEOS -> MEOS-API catalog -> JMEOS).
estebanzimanyi
force-pushed
the
consolidate/flink-benchmark
branch
from
July 8, 2026 09:41
5697d6d to
542288b
Compare
estebanzimanyi
changed the base branch from
consolidate/flink-meos-integration
to
main
July 8, 2026 09:42
Collaborator
|
The documentation is not updated to fir the code |
- Align the BerlinMODBenchmark Javadoc to the code: the corpus is the real BerlinMOD instants CSV (--csv, required); drop the stale --vehicles/--events synthetic-mode reference and the dead 'synthetic' corpus label. - Wrap each cell's Flink job (env.execute) in try-catch so one failing cell is recorded and the matrix continues instead of aborting. - Comment the deliberate keyBy(x -> 0) single-subtask routing in Q5/Q9 (the pairwise-meet / all-pairs queries need a global, non-parallel view). - Cover the benchmark in the suite: add BerlinMODBenchmarkTest (a keyed cell and a keyBy(x -> 0) cell over a small in-memory corpus), and remove the nine misplaced BerlinMODQ*LocalTest main-drivers that sat in src/main (test-named, never run by mvn test, and dependent on an uncommitted sample resource).
Member
Author
|
Thanks for the review — all four addressed in 0303853:
|
Ar-mie
added a commit
that referenced
this pull request
Jul 9, 2026
build(flink): migrate to Apache Flink 2.0 (stacks on #31)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds the BerlinMOD streaming throughput benchmark and regenerates the in-repo
org.mobilitydb.meos.MeosOps*facades, with the vendoredJMEOS.jar+libmeos.sorebuilt from the current MobilityDB master surface via the canonical chain MEOS → MEOS-API catalog → JMEOS (track-master-surface).tools/codegen_facades.pyemits the 57MeosOps*forwarder facades from the bundled JMEOSfunctions.GeneratedFunctions∩ the streaming-relevance baseline.MeosSetSetJoinrecovered as source.JMEOS.jar/libmeos.sobuilt from MobilityDB master (4493-function catalog).Verification
mvn test→ 10 tests, 0 failures, 0 errors, 0 skipped.