• Data Model collaborative development for all the users with data model editor role
• Data Model will have multiple versions but only one version can be published and it will be immutable once published
• Secure Computation Node is active all the time and has all the uploaded datasets mounted on it. A new SCN is provisioned when a new dataset is uploaded and the old SCN is deleted
• Seamless integration of the researcher portal and PAG backend to perform computations on your uploaded datasets. This improvement completes end-to-end functionality of the deta federation tool.
• Revamped Feature List View: We've given the feature list in the researcher portal a fresh look and feel. The updated view provides a more intuitive and organized way to manage your research project's features.
• Improved PAG Dashboard and Comparative Analysis Tool: Our PAG dashboard and comparative analysis tool have received a makeover and has been integrated within the new UI.

Features

• Re-design of the sail user portal
  • Moved the data model edit functionality to the user portal
  • Data Upload validation and upload functionality moved to the user portal
• User Roles and Permissions
  • SAIL_ADMIN, ORGANIZATION_ADMIN, USER, DATA_SUBMITTER, RESEARCHER, PAG_ADMIN, DATA_MODEL_EDITOR user roles have been added
  • Freemium users can only be assigned ORGANIZATION_ADMIN, USER and DATA_MODEL_EDITOR roles
  • Paid users can be assigned a combination of above roles
  • A freemium organization can be converted to a paid organization only by a SAIL_ADMIN user
  • The user portal will display different functionalities based on the user roles
• Audit Service Fixes
  • The logs now contain the request and response status code for the REST API calls
  • Better filtering mechanism for the logs based on the resources and the user
  • Audit Logs also obey user roles

Bug Fixes

• API Service has better permission checks and error handling

Compatibility Notes

• The older version of the sail user portal will not work with this version of the sail platform services

Features

• Data upload via UI
  • Data validation against data model on browser before upload
  • Data is sent to data upload service(a Confidential VM), key generated, encrypted, and key and data stored on azure key vault
  • Encryption during transit TLS enabled
• Manage Researcher Portal from UI
  • Researcher Portal can provisioned and deprovisioned from the UI by researcher user
  • Researcher Portal loads data and spins up Notebook environment automatically for data analysis
• Gateway
  • Single Public IP with wildcard TLS certificate to interact with all the sail services using nginx as gateway and TLS endpoint
  • Private DNS Resolution server is setup and used by nginx to resolve all URL for traffic re-direction within the VPN using private IPs
  • DNS entries can be edited runtime by internal services
• TLS setup
  • Certificate obtained from Let's Encrypt (has to be manually replaced on expiration - 90 days)
  • Manual step at deployment time to create certificates for the asked domain
• Auditing
  • Audit logs accessible using a REST API
  • Logs are captured for all the API calls to SAIL Platform Services API

First ever Release!

"Stable Platform"

What's Changed

• Removing files accidently commited to Engineering by @David-G-SAIL in #1
• BOARD-597 Add IP and Port to Login API by @David-G-SAIL in #2
• BOARD-760 Add OrganizationName DS family pull by @David-G-SAIL in #3
• BOARD-773 BOARD-634 Add api to load Safe Functions by @David-G-SAIL in #4
• [BOARD-756] no kill on heartbeat timeout and using Dseries VM, VM ima… by @prawalgangwar in #6
• [BOARD-681] [BOARD-581] seperate azure code + timeout fixes by @prawalgangwar in #5
• Board 776 - Adding automatic EOSB rotation for the logged in user by @David-G-SAIL in #7
• BOARD 774 Add DC caching and functions by @David-G-SAIL in #10
• BOARD 644 - Return 503 if we have too many connections by @David-G-SAIL in #11
• BOARD-775 Add GetDatasets to the Orchestrator by @David-G-SAIL in #13
• BOARD 910 by @David-G-SAIL in #16
• Update Jenkinsfile by @JENKINS-SAIL in #18
• BOARD-644 Fix up the Database gateway connections by @David-G-SAIL in #14
• [BOARD-763] Dockerfiles for backend and orchestrator by @prawalgangwar in #15
• BOARD-457 Return None for no data by @David-G-SAIL in #20
• BOARD 781 - Expose API calls to get a list of cached tables by @David-G-SAIL in #21
• Board 779 by @David-G-SAIL in #22
• BOARD-897 safe object compiler by @JingweiZhangBoston in #17
• [BOARD-492] Dockerfile for development by @prawalgangwar in #24
• [BOARD-670] secure computation binaries dockerization by @prawalgangwar in #26
• [BOARD-990] backend initialization vector by @prawalgangwar in #27
• [BOARD-1005] Scripts to create builds and packages by @prawalgangwar in #28
• [BOARD-1049] Frontend in Engineering reposiroty by @prawalgangwar in #29
• BOARD-452 and BOARD-758 by @LuisMiguelHuapaya in #12
• BOARD-574 by @LuisMiguelHuapaya in #9
• BOARD-572 by @LuisMiguelHuapaya in #8
• BOARD-103 by @LuisMiguelHuapaya in #19
• BOARD-998 BOARD-594 BOARD-459 BOARD-970 BOARD-1000 by @LuisMiguelHuapaya in #33
• [BOARD-669] [BOARD-1048] docker reform and new bootstrap by @prawalgangwar in #30
• BOARD-782 BOARD-992 APIs for running jobs by @David-G-SAIL in #31
• [BOARD-1002] vm image create automation using packer by @prawalgangwar in #34
• BOARD-550 Add a login prompt to the API by @David-G-SAIL in #36
• BOARD-995 BOARD-996 APIs for SCN provisioning by @David-G-SAIL in #35
• [BOARD-1060] fix the expiry of scn image by @prawalgangwar in #37
• [BOARD-1053] host for vm Data Owner instead of SAIL by @prawalgangwar in #38
• [BOARD-999] upload data to VMs running new bootloader by @prawalgangwar in #39
• [BOARD-206] initilaization vector for SCN by @prawalgangwar in #40
• Revert "[BOARD-1053] host for vm Data Owner instead of SAIL" by @prawalgangwar in #41
• BOARD-1192 Remove commented out code by @David-G-SAIL in #43
• BOARD-1056, Preloaded dataset families Organization name vis Data Owner by @stanleylinSail in #42
• BOARD-1192 Move the Orchestrator to EndPointTools by @David-G-SAIL in #44
• BOARD-1056 Fix tests to use the right user for our tests by @David-G-SAIL in #45
• BOARD-1192 Move Orchestrator to a new file name by @David-G-SAIL in #47
• [BOARD-1003] ignore SIGPIPE signal and Tls Timeout by @prawalgangwar in #46
• BOARD 1214 Fix up the create daily build script by @David-G-SAIL in #50
• [BOARD-1213] removing Tls timeout to fix failure by @prawalgangwar in #51
• [BOARD-1050] apt registry cleanup in dockerfile by @prawalgangwar in #48
• [BOARD-671] [BOARD-1005] webfrontend package and use initialization v… by @prawalgangwar in #52
• BOARD-1178 by @LuisMiguelHuapaya in #53
• BOARD-1176 Load AZ Template from IV by @David-G-SAIL in #54
• Update Nightly Pipeline Test script by @stanleylinSail in #55
• Removed string interpolation vulnerability and re-issued new PAT in GITHUB by @stanleylinSail in #56
• [BOARD-1207] check the scn package locally first by @prawalgangwar in #58
• Board 1106, BOARD-969 by @David-G-SAIL in #59
• Board 1191 by @David-G-SAIL in #60
• [BOARD-1226] removed old DatasetSpec tool, PackageWebServiceAndComputeVm, edited CreateDailyBuild by @prawalgangwar in #62
• [BOARD-1170] azure arm templates by @prawalgangwar in #57
• BOARD-1177, BOARD-1004, BOARD-994 by @LuisMiguelHuapaya in #64
• BOARD-1175 - Bug fixups for David by @LuisMiguelHuapaya in #65
• BOARD-1175: Fixing bugs with JsonParser and some weird interop bug by @LuisMiguelHuapaya in #66
• BOARD-1059 Fix TLS connection bug by @David-G-SAIL in #67
• [BOARD-1241] database persist over multiple runs by @prawalgangwar in #68
• [BOARD-1266] databasetools cleanup by @prawalgangwar in #70
• BOARD-1059 Change the dataset upload port by @David-G-SAIL in #73
• [BOARD-312] one script to deploy all by @prawalgangwar in #69
• [BOARD-1285] allow 9090 for scn provisioning from backend by @prawalgangwar in #76
• [BOARD-1396] renewed link to scn arm template by @prawalgangwar in #79
• [BOARD-1344] deploy scn with new arm template by @prawalgangwar in #80
• BOARD-1404, Docker Stop and Deprovision Script by @stanleylinSail in #83
• BOARD 1059, BOARD 1178, BOARD 1047, BOARD 1239 by @David-G-SAIL in #81
• BOARD-1178 by @LuisMiguelHuapaya in #72
• BOARD-1059 Get the real name for provisioning by @David-G-SAIL in #85
• [BOARD-1397] [BOARD-1400] deploying VMs in VPN Vnet by @prawalgangwar in #84
• BOARD-1410, Shell check fixes, and adding in script Pathing by @stanleylinSail in #86
• BOARD-1408 by @David-G-SAIL in #88
• [BOARD-1373] eosb return in scn provision response by @prawalgangwar in #87
• [BOARD-1399] standarad username and password by @prawalgangwar in #90
• [BOARD-1398] owner and purpose of deployment by @prawalgangwar in #89
• BOARD-1059 - Handle privacy violation state by @David-G-SAIL in #91
• BOARD-1253, BOARD-1262, BOARD-1248, BOARD-1249, BOARD-1258, BOARD-1259, BOARD-1279, BOARD-1277, BOARD-1280, BOARD-1260, BOARD-1242, BOARD-1278 by @LuisMiguelHuapaya in #77
• [BOARD-1299: BOARD-1304] devops console API gateway by @prawalgangwar in #92
• [BOARD-407] new database tool for demo by @prawalgangwar in https://github.com/secureailabs/Engineering/...