AI quality assurance · Content evaluation · Digital product QA

AI Quality Portfolio

Lisa Marie Kocian

AI Quality Assurance & Content Evaluation Specialist

Evaluating AI output. Improving content quality. Building better digital experiences.

I work at the intersection of AI quality and content evaluation — combining AI output evaluation, prompt iteration, content review, and human judgment to identify problems, improve clarity, and build more reliable digital experiences.

Better AI products for real people.

Selected work

Real products. Real people.

A selection of projects where I have contributed to AI quality, content evaluation, and digital product QA, from e-commerce experiences to mission-driven resources.

01

Commerce Application & Workflow QA

Torch Republic Coffee Company

AI-assisted commerce development with Shopify integration and end-to-end review of the customer journey, from product discovery through checkout, with documented defects and quality improvements.

  • AI-Assisted Development
  • Shopify Integration
  • Customer-Journey Review
  • Commerce QA
Torch Republic Coffee Company mobile storefront: the lifestyle section, with a hiker resting at sunrise beside a pouch of coffee under the heading "Your cup in nature, before the trail begins".
torchrepublic.com
02

Content Quality & Youth Resource Usability

Luke's Light

An educational support resource focused on clear guidance, accessible navigation, and careful review of AI-assisted content.

  • Content Quality
  • Usability Review
  • Accessible Navigation
  • AI Content Review
Luke's Light artwork: an illustrated lighthouse with its beam lit, standing on a dark shoreline.
lukeslight.org

Skills

Six capability frameworks

The same iterative evaluation loop applied to both AI-output review and digital-commerce testing.

01

AI Output Quality & Evaluation

Output evaluation, accuracy review, consistency, guideline adherence, error identification, hallucination awareness, edge-case thinking, human review, user-impact evaluation.

02

Prompt Iteration & Model Behavior

Prompt refinement, comparison testing, instruction clarity, output evaluation, failure-pattern identification, systematic iteration, feedback loops.

03

E-Commerce UX & Conversion QA

Product discovery, customer journey, navigation, mobile usability, product presentation, cart behavior, checkout friction, conversion thinking, visual QA, information architecture.

04

AI Workflow Implementation

Identifying repetitive work, AI-assisted workflows, automation opportunities, content/research workflows, operational efficiency, human-in-the-loop review, implementation testing.

05

Systems & Integration Thinking

Storefront systems, customer data, analytics, AI tools, marketing workflows, product information, user experience, third-party platforms, interconnected processes.

06

Documentation & Continuous Improvement

Defect identification, reproducible observations, QA documentation, testing notes, before/after comparison, prioritization, troubleshooting, iteration, actionable recommended fixes.

Professional process

  1. Observe
  2. Test
  3. Identify
  4. Iterate
  5. Validate
  6. Measure

The same iterative loop applied to both AI-output evaluation and digital-commerce testing.

Experience

Professional experience

AI Quality Review Contractor

Alignerr · 2026 to Present · Remote

Published Author & Editorial Project Lead

The Stop Trying Method / Independent Publishing · 2025 to Present · Remote

Founder / AI E-Commerce Product & Quality Lead

Torch Republic Coffee Company · 2025 to Present · Remote

Remote Freelance Paralegal / Legal Document QA

Self-Employed Contract Support · 2020 to 2023 · Remote

Tools

Tools & platforms

Technologies listed reflect practical working knowledge gained through applied projects, not expert engineering experience in every tool.

Tools & platformsFive areas5

AI & Evaluation

LLM output evaluation; prompt/instruction testing; AI performance QA; NLP-aware review; hallucination detection.

Product & Commerce

Shopify; Base44; GA4; Google Search Console; customer-journey, cart, and checkout QA.

Working Technical Knowledge

React / JavaScript; APIs and GraphQL; Node.js / Python; GCP / Kubernetes; MySQL / PostgreSQL.

QA Methods

Defect reproduction/docs; regression & revalidation; direct-route testing; access-control review; privacy / PII review.

Dev Practices

GitHub version control; Agile workflows; Jira; UiPath Automation.

Methods

Quality assurance methods

Quality assurance methodsApplied on every project13
  • Requirements-to-test translation
  • Acceptance criteria
  • Exploratory and direct-route testing
  • Expected-vs-actual comparison
  • Functional and interface testing
  • API / integration validation
  • Defect reproduction and documentation
  • Error categorization
  • Source verification
  • Version comparison
  • Regression and revalidation
  • Privacy / PII review
  • Evidence-based corrective feedback

Credentials

Certifications & professional development

Programs shown with a year are completed; the rest are in progress or in preparation.

Certifications & professional development11 programs11
Jira Fundamentals BadgeAtlassian University, 2026
Introduction to Automation DiplomaUiPath Academy, 2026
Google Analytics CertificationGoogle Skillshop, 2026
Intro to Machine LearningKaggle
Intermediate Machine LearningKaggle
Responsive Web DesignfreeCodeCamp
Career Essentials in Generative AIMicrosoft & LinkedIn
AI FundamentalsIBM SkillsBuild
AI EssentialsGoogle
Agentic AIDeepLearning.AI
AWS Certified AI PractitionerAmazon Web Services

Let’s talk about AI quality and content evaluation.

For opportunities in AI evaluation, content review, and digital product QA, contact me by email.

lisakocian@outlook.com

Résumé available by email.

LinkedIn

Lisa Marie Kocian

AI quality assurance & content evaluation

© 2026 Lisa Marie Kocian

Case studies are presented as independent examples of applied quality assurance and product development.