SaaS / B2B Software · Multicloud QA Automation
Lucidity
SaaS cloud storage intelligence platform with an Electron-based desktop assessment/audit tool (multi-cloud.
The brief
Embed a full-time QA Automation engineer to own end-to-end quality assurance for Lucidity's cloud assessment (audit) tool and SaaS dashboard, covering multi-cloud functional testing (AWS, Azure, GCP), automation framework development, and CI/CD pipeline integration — ensuring product reliability as Lucidity scales its cloud storage optimization platform toward enterprise customers.
What we built
A comprehensive, multi-layered QA automation system for Lucidity's cloud storage optimization platform. This includes:
- A Gradle/Java E2E test framework for the desktop audit/assessment Electron app covering AWS, Azure, and GCP multi-cloud flows with column validation, delta value checks, and OS detail verification
- A Playwright UI automation framework for the Electron assessment app and SaaS web dashboard
- A Summary-Level Testing (SLT) framework for automated report sheet validation integrated into CI
- Visual regression automation for the dashboard, Scaler module, website, and mobile views
- Feature test suites for advanced infrastructure (AKS, EKS, ASR, clustered storage)
- Cross-OS compatibility testing across Windows Server 2020/2025 and Ubuntu 20.04/2024
- Jobs revamp, disk limit, CSV tag, and agent install search bar automation for the SaaS dashboard. All automation was PR-gated and CI-pipeline integrated via Bitbucket.
Assessment app v2 (Electron desktop) fully tested and signed off across AWS, Azure, and GCP; Playwright UI automation suite live for dashboard features (Jobs, Disk Limit, CSV tags, Agent Install); SLT report validation framework integrated in CI pipeline; Visual regression suite active for Dashboard, Scaler, and website; Advanced feature coverage for AKS, EKS, ASR, and clustered storage in production.
Delivery timeline
How it was built, phase by phase.
8 workstreams across 43 weeks of operated delivery.
- discoverWeek 1–2 (Feb 17–28, 2025)
Audit/Assessment App Onboarding & Environment Setup
Initial onboarding, codebase walkthrough, environment configuration across AWS, Azure, GCP, and DB setup. Establishes the foundation for all subsequent QA activity on Lucidity's cloud audit tooling.
Full dev environment operational; QA engineer enabled to run end-to-end audits across all three cloud providers
AWSGCPAzureBitbucketPostgreSQL/DB - buildWeek 2–14 (Feb 21 – May 9, 2025)
E2E Automation Framework for Audit Tool (Gradle/Java)
Design, implementation, and maintenance of an end-to-end automated test framework for Lucidity's audit/assessment tool, covering OS details verification, column validation, delta values, and multi-cloud test plans.
Comprehensive e2e test suite covering AWS, Azure, GCP audit flows with column validation and deployment readiness checks
GradleJavaBitbucketAWSGCPAzure - testWeek 3–21 (Feb 20 – Jun 30, 2025)
Multi-Cloud Functional & Regression Testing (AWS, Azure, GCP)
Extensive manual and semi-automated functional testing across AWS, Azure, and GCP cloud providers, covering full audit flows, error messages, IAM/role permissions, upload flows, CA certificates.
All major multi-cloud flows (AWS, Azure, GCP) validated and signed off for v2 assessment app release
AWSAzureGCPBitbucketAmplitude - testWeek 10–22 (Apr 23 – Jul 4, 2025)
Assessment App v2 Feature Testing (New UI, Rename, Analytics)
Testing of the v2 frontend redesign including the audit-to-assessment rename, new upload page, analytics via Amplitude, digital signature verification, multi-run command support for services/processes.
v2 FE signed off across all three cloud providers with analytics, digital signatures, and multi-run command support validated
AmplitudeBitbucketAzureAWSGCP - testWeek 22–26 (Jul 10 – Aug 4, 2025)
Cross-OS & Cross-VM Compatibility Testing
Systematic testing of the assessment application across multiple OS environments: Windows Server 2020, Windows Server 2025, Ubuntu 20.04 LTS, Ubuntu 2024, and other Linux distributions.
Assessment app v2 validated across major Windows and Linux OS versions used in enterprise cloud environments
Azure VMsWindows Server 2020Windows Server 2025Ubuntu 20.04Ubuntu 2024 - buildWeek 27–33 (Aug 5 – Sep 26, 2025)
Playwright UI Automation Framework
Research, setup, and implementation of Playwright-based UI automation for the assessment (audit) Electron app, covering Azure, AWS, and GCP flows, including POC for Electron app automation.
Playwright UI automation framework live for Azure and AWS assessment flows, GCP in progress
PlaywrightElectronAzureAWSGCPBitbucket - buildWeek 29–34 (Aug 27 – Sep 16, 2025)
SLT (Summary Sheet Level Testing) Automation
Design and implementation of automated Summary Level Testing for report sheet validation — validating generated Excel/CSV reports from the assessment tool against expected output.
SLT framework integrated into CI pipeline for full report sheet validation across all test IDs
Python/Java (SLT framework)CI/CD pipelineBitbucketExcel/CSV - buildWeek 34–42 (Oct 14 – Nov 25, 2025)
Dashboard & Jobs Revamp Automation (Playwright)
Playwright-based automation of Lucidity's main SaaS dashboard features including Jobs Revamp, redirection flows, unrealized savings sort, disk limit verification, CSV tag onboarding, agent install search bar.
Jobs revamp, disk limit, CSV tag, and agent search bar fully automated and PRs ready to merge
PlaywrightBitbucketCI/CD pipeline
More case studies
Related work
09 · Run a function
Stop renting hours. Start running functions.
Pick the function you want off your plate. We'll map the brain and name the outcome we'd commit to — before you do.