maven - Dependency management with spark -
i'm running spark jobs through airflow. rather hardcoding path, or having directory bucket of jars, i'd use dependency manager tell me jars in local repo (and better, maybe them remote repo if not available).
is there tool exists can either 1 or both of these things? i'd happy sbt plugin, apache ivy, or else completely.
even better if it's sbt can publish to.
Comments
Post a Comment