Release notes release/0.15.3

Released 2022-10-27

Update of dependencies, enhancements to REST APIs and when running job.map() in a cloud setup

What’s Changed

Full Changelog: https://github.com/omegaml/omegaml/compare/0.15.2…release/0.15.3

Changes

  • Merge pull request #298 from omegaml/release-build-0.15.3 87d3d34

  • build 0.15.3 f6bb158

  • Merge pull request #288 from omegaml/release-0.15.3 b1f1bd8

  • Bump version: 0.15.3-rc1 → 0.15.3 fdf1288

  • upgrade dependencies 7698873

  • Bump version: 0.15.3-dev1 → 0.15.3-rc1 536a63e

  • Merge pull request #295 from omegaml/upgrade-dependencies cc5682d

  • Bump version: 0.15.2 → 0.16.0-dev1 053a87f

  • Merge pull request #281 from omegaml/enable-swagger-array-objects 43e53c6

  • enable swagger responses as list of objects 96e97ce

  • Merge pull request #283 from omegaml/enable-nbtasks-auth-env 6a48446

  • nbtasks: uses task authentication env 7e4b6da

  • Merge pull request #247 from omegaml/release-build ed01fb1

  • change to pytest 76168aa

  • Merge pull request #286 from omegaml/update-dependencies 3bf7c0a

  • dependencies 69b3f03

  • Merge pull request #280 from omegaml/runtime-export-override-action c6c4dbd

  • runtime export: allow override action ff13016

  • Merge pull request #279 from omegaml/allow-dedicated-apphub-url f6d0c9c

  • allow dedicated apphub url ac32ca6

  • Merge pull request #282 from omegaml/allow-readonly-mongodb-user 736d488

  • allow read-only mongodb user c67e0be

  • Merge pull request #278 from omegaml/enable-versionined-virtualmodels 81dd6d1

  • model-virtualobj can be versioned d429a00

  • Merge pull request #274 from omegaml/enable-celery-monitoring-hook 7445953

  • authentication env monitoring hook 4653cab

  • Merge pull request #273 from omegaml/snyk-fix-0cf5677a880c98e30987d885c9c76e4b 7b9c52a

  • Merge pull request #272 from omegaml/fix-271 1cc01bd

  • ensure om.runtime default tracking is applied bd556c8

  • Merge pull request #243 from omegaml/fix-local-worker-config 43640d8

  • load config file for local in-memory worker ddf3e50

  • Merge pull request #248 from omegaml/snyk-fix-eaababdecb37a011c3270228478b7cb7 d891d53

  • Merge pull request #267 from omegaml/snyk-fix-02082b151e1af71146d78faa124dc332 0dc1879

  • Merge pull request #263 from omegaml/snyk-fix-d5d0d40d262b0f27cb5ba291fff56e87 176fb95

  • Merge pull request #259 from omegaml/snyk-fix-9233fb96e982f91dcfcf6f42fd9ed961 a469ec8

  • Merge pull request #270 from omegaml/windows-compatibility 49db68d

  • improve windows compatibility e438fb8

  • Merge pull request #268 from omegaml/enable-link-swagger b73295a

  • Merge pull request #262 from omegaml/experiments-log-userid 37110b6

  • log task and userid on experiment and logging records 97d109b

  • Merge pull request #265 from omegaml/simplify-logger df9c3d2

  • Merge branch ‘master’ into simplify-logger dcc6742

  • Merge pull request #266 from omegaml/remove-apikey-from-log 93fd75c

  • remove apikey from log output f3e75d2

  • simplify logger access e6619f1

  • Merge pull request #264 from omegaml/simplify-logger 77ae2f0

  • simplify logger access 914dc6e

  • Merge pull request #261 from omegaml/enable-om-deploy 53c2bd1

  • integate omdeploy utility as om runtime deploy ca71f02

  • Merge pull request #260 from omegaml/update-dependencies 151c002

  • python 3.10 build support f768c8d

  • Merge pull request #255 from omegaml/windows-compatibility 1a3248c

  • Merge pull request #256 from omegaml/pandas-dtypes-api-spec 709d280

  • win10.x compatibility 6664310

  • datatype compatibility for service api signature addabbd

  • Merge pull request #257 from omegaml/fix-mlflow-gitissue 8fc4b97

  • disable remote mlflow project testing due to issue with conda envs fbb7335

  • Merge pull request #244 from omegaml/enable-swagger-api de46391

  • enable service api to ecdc3b8

  • Merge pull request #251 from omegaml/py38-stability c7abf78

  • increase py38 stability f9d131a

  • Merge pull request #249 from omegaml/refactor-tracking-dataset 062fdb0

  • Merge pull request #250 from omegaml/refactor-pkg-build ecc8ba3

  • add pre-/post task hooks using common .perform() backend method (#246) 8da573f

  • Improve token auth (#242) 4ab1d78

  • runtime.scripts/tasks uses delegate pattern to call the backend (#240) 0749aa7

  • various bug fixes (#236) 9382db1

  • enable client-provided jwt authentication (#233) e140935

  • fup to auth env refactorign, upgrades of pymongo, performance tuning (#230) a5eefdb

  • upgrade pymongo 4.1 (#225) 6f59bde

  • upgrade rabbitmq (#229) 847649a

  • fup auth refactor updates (#228) 4c012cb

  • auth refactoring to simplify alternative auth schemes (#226) 8c22cec

  • runtime performance improvement (#223) 82cb8d8

  • upgrade pymongo, mongodb, pandas, celery dependencies (#220) 2e7b3d3

  • remove no longer useful six lib dependency (#224) bd7de96

  • cli: add om runtime serve (#210) e02820a

  • various updates (#222) ab27ad5

  • Further docs (#214) 2ddb698

  • enable qualifer selection on login (#219) 5738151

  • add generic exporter/importer for all type of objects (#217) fa5ddc2

  • MDataFrame.persist().transform() re-reads columns from actual data (#212) 8ff0e56

  • upgrade dependencies (#215) 3475692

  • update documentation (#209) 52e8699

  • combined updates across all release base builds (#208) (#213) 51dddd5

  • enable r integration in oss release (#205) fbc1a4e

  • upgrade to docker stacks datascience-notebook (#207) afc6978

  • cli: runtime env install properly processes –file option (#204) 1dee325

  • use miniforge3 as a base environment (#206) d422fd9

  • enable running MLFlow models from tracking uri (#202) 3e64d18

  • cloud login shall request in-cluster services if running in cluster (#201) 302e329

  • various updates (#200) beb12b6

  • enable mlflow integration (#197) eaba8a1

  • updating logging semantics (#198) 1cfb414

  • add a profiling experiment tracker that records cpu, memory, disk data (#196) e249b85

  • enable tracking link to model metadata (#193) 4e666b7

  • improve tracking (#195) b467920

  • add generic runtime call tracking and experiment store (#189) 81cf5ce

  • enable implicit url support in OmegaStore.help() (#191) 39ca30e

  • enable om shell jupyter (#188) 182f901

  • update dependencies to better match compatible packages (#190) c512cc0

  • minor maintenance items (#187) 093f9f2

  • enable multi-cloud provider access to k8s status (#179) 989c2ca

  • ensure pickable collection recreates mongoclient with ssl flag, even if not in om.defaults (#178) 2ddd03f

  • enable dns uris in mongodb+srv format (#182) 772eda1

  • several updates (#180) b841248

  • release support for tenant deployment in commercial edition (#173) faf6f31

  • Wip (#166) fcb7102

  • enable apphub remote cluster at different url from restapi (#170) 062593f

  • replace flaskrestplus, enable better cli support for csv, image and binary files (#172) f0bfd55

  • enable automated data revisions for dataframes (#171) 5440ad2

  • enable task callbacks (#157) 94902a4

  • add improvements for job.map() (#162) 98b204a

  • document release process (#161) 59eb185

  • Python39 (#167) 02cd1ba

  • restrict license to No Sell, Consulting Yes clause (#165) d7a6301

  • Rename NOSELLCLAUSE to LICENSE-NOSELLCLAUSE (#164) d824359

  • Create NOSELLCLAUSE (#163) 03962ea

  • Improve docs (#158) 567f15f

  • Release 0.13.7 (#160) f18d841

  • enable dataset names of arbitrary length (#154) 845d99e

  • simplify access to celery commands via om runtime (#155) 6eb811f

  • Enhance base loading (#152) 50e2966

  • ensure compatibility with omegaee (#151) 8c3a39c

  • Revert “Upgrade dependencies (#148)” (#149) d02b618

  • Upgrade dependencies (#148) 1788afc

  • enable parallel notebook tasks (#146) f6e967b

  • Refactor cli (#144) 72495e9

  • update docs (#118) 5149735

  • add task chaining (#143) 9b9dca5

  • enable worker utilities (#142) b4c780a

  • enable cli cloud status report and pod log access (#136) ddb7974

  • return the users value instead if valid (#138) 7e3cc87

  • various improvements (#132) 2e81c32

  • various improvements (#131) 0fec919

  • several stability updates and bug fixes (#126) a37eebe

  • Release build (#124) fea89c2

  • enable combined stores (#120) 841e19c

  • add streams as a first-class object type (#121) b7b732e

  • various improvements (#119) da5675f

  • Simplify releases (#122) 0a2db44

  • enable bucket namespacing for sql datasources (#116) 9da78b5

  • support omegamlee-1.4.1 (#115) 7a03043

  • enable remote source packages (#113) 5c6d56d

  • updates for stability and increased performance (#111) 22ffcb2

  • enable tensorflow 2.3.0 (unit testing) (#110) c3e9e5e

  • enable promotion of versioned models to work as expected (#109) b20e8c6

  • various updates, stability improvements (#105) 89bdb96

  • apply several fixes, bump version (#104) 30a487c

  • enable implicit chunking by yielding an iterable from dataset name (#102) 4942a9f

  • enable kwargs for smartopen, supporting az blob storage (#99) c708114

  • enable async rest api (#98) 6566911

  • add externaldata backend, make jobs run return metadata repr, rawfiles enhancement (#97) c646673

  • improve tensorflow 2.x compatibility (#100) c6d8d5d

  • version bump (#96) 2a0aa21

  • ensure rname works the same everywhere (#91) aa243ce

  • various stability improvements, tensorflow 2.0 support (#76) fad7054

  • enable storing dash apps (#89) 808b53b

  • bump version (#88) 1866abc

  • enable automated model versioning (#65) d55638e

  • Integrate omxiotools (#86) 85fa1ef

  • add mdataframe native pandas parallel transform (#85) 8e0693f

  • bump version, fix formatted log messages (#83) 7a4fd2e

  • bump version (#82) 6457c57

  • enable storing sqlalchemy connections (#80) 0005c95

  • add straight forward logger as well as python logging handler (#81) 1160b02

  • Enable custom cell timeout 77 (#78) 98c55ef

  • apply various fixes (#74) ae8daf4

  • Multi pyversion build 70 (#75) 94a743f

  • enable python3.7 cli compatibility (#71) b2b2153

  • documentation updates (#64) 7ebef49

  • build release (#62) b88869c

  • enable user configuration and extensions inside docker-compose (#61) 048f99d

  • enable jupyterhub, jupyterlab, dashserve (#60) 8f9801a

  • bump version (#59) 3558495

  • resolve several dependencies (#57) f2e3914

  • resolve deprecated scipy dependency (#55) 2f892ba

  • resolve deprecated scipy dependency (#54) c99afed

  • resolve deprecated scipy dependency (#53) d75baa6

  • enable run script to use custom serializers (#52) 9891710

  • cli updates (#51) 26c4b5b

  • various updates, performance, flexibility, stability improvements (#50) 880f727

  • add cli (#40) b411016

  • Create mongoshim that updates MongoClient with additional SSL kwargs (#49) c954bc3

  • Build PRs against current master on CI (#45) 61ce070

  • upgrade tensorflow to 1.15.0 (#46) fc8acfd

  • make tz testing static in time, remark on limitted tz dst support (#44) 70c2630

  • update dependencies consistent with pandas 0.25.1 (#43) 1264fdc

  • enable project, user and global config file (#42) 8d0c0b7

  • Merge pull request #41 from omegaml/enable-buckets-on-deferred ee6d6cf

  • Merge branch ‘master’ of github.com:omegaml/omegaml 3ba350f

  • enable client api, fix test with sklearn dependencies sklearn (#39) 7d6a6c3

  • enable scripts runtime (#38) 963559a

  • enable context/context, bucket/bucket promotion (#35) ba31e92

  • Add Livetest step to CircleCI configuration. (#37) 10b0ff4

  • Merge branch ‘master’ of github.com:omegaml/omegaml 5db192a

  • enable client api, fix test with sklearn dependencies sklearn removed the n_iter argument from SDGRegressor in 0.21.3 (#32) fb735ab

  • Add CircleCI configuration for unit tests (#33) 598cb71

  • Release 0.11.2 (#30) 7ee94f6

  • enable arbitrary collections to be used as dataframe source (#21) f4dcae9

  • updates (#28) aac1685

  • Update README.rst 5e1d0e9

  • Update README.rst f74ebc2

  • updates 3c6f78a

  • enable keras models, including tpu support (#15) bacd5df

  • Merge pull request #24 from omegaml/23-context-initialize-metadata f76dc91

  • make mongoengine Metadata bound to instance context 224f668

  • Merge pull request #20 from omegaml/19-omegaruntime-common-kwargs 0042e14

  • Merge pull request #22 from omegaml/fix-shippable-miniconda eea4363

  • ensure specific miniconda version 1c6b14b

  • bump version 69ac8f6

  • Merge pull request #18 from omegaml/enable-jupyternb-subdirectories-files 5a51c96

  • update livetest to work with headless chromedriver 36cde47

  • bump version a9703a3

  • enable notebook directories, sub directories (basic implementation & tests) e9f535e

  • update headlines 0246830

  • Merge pull request #13 from omegaml/add-package-testing 94ce14c

  • bump version 9511983

  • added livetest installation using docker 4d53d92

  • Merge pull request #12 from omegaml/update-readme 3ff1527

  • update README, tag line, bump version 121cdb4

  • remove warnings, fix unit tests 829e95d

  • Merge pull request #11 from omegaml/10-update-dependencies 41dc132

  • updated to latest versions b6fbbf8

  • Merge pull request #3 from omegaml/ready-to-publish 74b4175

  • quality assurance 000ce65

  • Merge pull request #2 from omegaml/ready-to-publish 787564d

  • quality assurance 915f5e3

  • Merge pull request #1 from omegaml/ready-to-publish 5dde910

  • automate release ed8b390

  • update license data e5813d7

  • ready to publish ada3773

  • commit to publish fa4a826

Bug Fixes

  • fix: pip-requirements.txt to reduce vulnerabilities 51d0f9e

  • fix: scripts/docker/omegaml-tensorflow/Dockerfile to reduce vulnerabilities 5543bb7

  • fix: pip-requirements.txt to reduce vulnerabilities de81317

  • fix: pip-requirements.txt to reduce vulnerabilities eb7faf0

  • fix: pip-requirements.txt to reduce vulnerabilities ac94a4c

  • fix compressed export filename (#245) fae9e33

  • fix kwargs on rawfile get() (#192) 8d430dc

  • fix command line parsing, cloud config (#150) ed12d19

  • fix filterops lt, lte, gt, gte (#140) f7dd35a

  • fixing several bugs (#123) 684f83d

  • fix mdataframe.merge duplicate keys error on 1:n merges (#117) b322a11

  • fix wrong argument passing in maybe_chunked (#103) cbd2ab6

  • fix windows ctrl-c sighup handling (#84) 8a67bee

  • fix issue with bucket access on deferred instance (#66) 1f02a39

  • fix issue with bucket access on deferred instance c278f8d

  • fix local install via pip f7b2d6d

Refactor

  • refactor swagger linking c8783ae

  • refactor tracking dataset metadata 79b11dd

  • refactor package build 4305271

  • refactor file storage (#87) 2d159da

  • refactor _common_kwargs to OmegaRuntime 5f60ca1