Skip to content

Add the catalog-driven Spark UDF generator (foundation)#27

Merged
estebanzimanyi merged 1 commit into
MobilityDB:mainfrom
estebanzimanyi:feat/spark-udf-generator
Jul 8, 2026
Merged

Add the catalog-driven Spark UDF generator (foundation)#27
estebanzimanyi merged 1 commit into
MobilityDB:mainfrom
estebanzimanyi:feat/spark-udf-generator

Conversation

@estebanzimanyi

@estebanzimanyi estebanzimanyi commented Jun 12, 2026

Copy link
Copy Markdown
Member

What

Adds tools/codegen_spark_udfs.py, the catalog-driven Spark UDF generator.

  • Reads the MEOS-API catalog (tools/meos-idl.json) and the JMEOS jar surface (via javap).
  • Emits the Spark UDF registrations, organized by doxygen @ingroup, mirroring the JMEOS FunctionsGenerator.
  • Standalone codegen script; the build wiring lands with the dispatch-surface change.

Foundation for the generated dispatch surface.

@estebanzimanyi estebanzimanyi force-pushed the feat/spark-udf-generator branch 2 times, most recently from c5dd081 to b939673 Compare June 13, 2026 02:28
estebanzimanyi added a commit to estebanzimanyi/MobilitySpark that referenced this pull request Jun 25, 2026
Add tools/pin/compose-order.txt (the canonical fold manifest; MobilityDB#28 generated
dispatch on the MobilityDB#27 generator) and GENERATION.md (the per-binding generator
policy: MobilitySpark binds the JMEOS jar and generates its Spark UDF surface
via tools/codegen_spark_udfs.py, retiring the hand UDFs generate-then-retire).
Generate the Spark UDF registration surface from the MEOS-API catalog
(tools/meos-idl.json), organized by doxygen @InGroup, mirroring the JMEOS
FunctionsGenerator. Standalone codegen script under tools/.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant