Skip to content

Register the catalog-generated UDF dispatch surface#28

Merged
estebanzimanyi merged 1 commit into
MobilityDB:mainfrom
estebanzimanyi:feat/generated-dispatch
Jul 8, 2026
Merged

Register the catalog-generated UDF dispatch surface#28
estebanzimanyi merged 1 commit into
MobilityDB:mainfrom
estebanzimanyi:feat/generated-dispatch

Conversation

@estebanzimanyi

@estebanzimanyi estebanzimanyi commented Jun 13, 2026

Copy link
Copy Markdown
Member

What

Registers the catalog-generated Spark UDF dispatch surface.

  • Wires the generator (tools/codegen_spark_udfs.py) into the Maven build at generate-sources, so the UDF surface — with overload dispatch and SQL-faithful arity — is emitted and registered at build time.
  • Vendors the master-tracked JMEOS jar (libs/JMEOS.jar) and the MEOS-API catalog (tools/meos-idl.json).
  • Adds the per-thread MEOS init/memory helpers (MeosThread, MeosMemory).
  • Covers the generated surface with GeneratedSurfaceTest (9 tests, all passing).

Stacked on the generator branch feat/spark-udf-generator; merge that first.

@estebanzimanyi estebanzimanyi force-pushed the feat/generated-dispatch branch from 1cb68f7 to de62e78 Compare June 13, 2026 12:01
estebanzimanyi added a commit to estebanzimanyi/MobilitySpark that referenced this pull request Jun 13, 2026
Pick up the generator's dispatch pass (MobilityDB#28): adds GeneratedUdfs_portable_comparison
with the 18 contract comparison bare names (everEq..everGe / alwaysEq..alwaysGe /
tempEq..tempGe) wrapping the MEOS superclass *_temporal_temporal entrypoints.
Compiles green; the bare names register alongside the hand PortableOperatorAliasUDFs.
@estebanzimanyi estebanzimanyi force-pushed the feat/generated-dispatch branch from 07da65e to 6b0ddd7 Compare June 14, 2026 08:12
estebanzimanyi added a commit to estebanzimanyi/MobilitySpark that referenced this pull request Jun 14, 2026
Picks up MobilityDB#28's type-safe UdfMarshal.*FromHex parsers (no SIGSEGV on a foreign
hex-WKB family) + topology span/temporal dispatch + sqlArity-faithful arity, so
the canonical BerlinMOD suite runs without the overlaps crash and asHexWKB/
trajectory resolve 1-arg.
estebanzimanyi added a commit to estebanzimanyi/MobilitySpark that referenced this pull request Jun 14, 2026
Picks up MobilityDB#28's type-safe UdfMarshal.*FromHex parsers (no SIGSEGV on a foreign
hex-WKB family) + topology span/temporal dispatch + sqlArity-faithful arity, so
the canonical BerlinMOD suite runs without the overlaps crash and asHexWKB/
trajectory resolve 1-arg.
estebanzimanyi added a commit to estebanzimanyi/MobilitySpark that referenced this pull request Jun 15, 2026
…overload, hex-reject guard

Vendored-generator sync with MobilitySpark MobilityDB#28: UdfMarshal.geoFromText (EWKT SRID-preserving,
hex-rejecting) for geo args + the eEq/eNe comparison dispatch now folds in the non-temporal
overloads (eEq(h3indexset, th3index) — the th3 cell-set prefilter). The prefilter q02/q04/
q11–q17 build geoToH3IndexSet/th3index/eEq and run end-to-end. 9/9 green vs libmeos 15e.
estebanzimanyi added a commit to estebanzimanyi/MobilitySpark that referenced this pull request Jun 25, 2026
Add tools/pin/compose-order.txt (the canonical fold manifest; MobilityDB#28 generated
dispatch on the MobilityDB#27 generator) and GENERATION.md (the per-binding generator
policy: MobilitySpark binds the JMEOS jar and generates its Spark UDF surface
via tools/codegen_spark_udfs.py, retiring the hand UDFs generate-then-retire).
@estebanzimanyi estebanzimanyi force-pushed the feat/generated-dispatch branch 2 times, most recently from e22a96d to 37195e3 Compare July 8, 2026 15:32
Wire the catalog-driven generator into the build (generate-sources) so the
Spark UDF surface — with overload dispatch and SQL-faithful arity — is emitted
and registered at build time. Vendor the master-tracked JMEOS jar + MEOS-API
catalog, add the per-thread MEOS init/memory helpers, and cover the generated
surface with GeneratedSurfaceTest.
@estebanzimanyi estebanzimanyi force-pushed the feat/generated-dispatch branch from 37195e3 to ada3ca6 Compare July 8, 2026 15:42
@estebanzimanyi estebanzimanyi merged commit 91758d4 into MobilityDB:main Jul 8, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant