Dr. Cari Miller
Education, Career, & Volunteer Background
Employment
Center for Inclusive Change - Lewes, DE
The Center for Inclusive Change is a research, training, and consulting organization dedicated to fostering responsible and ethical AI development and implementation.
Co-founder / Head of Responsible AI Governance & Research - 10/2020 to Present
Senior-level consultant to leaders, officials, and teams of all AI literacy levels in international, national, state, and local governments, non-profits, and private sector organizations on AI governance and risk management policies, processes, and practices.
DUTIES AND RESPONSIBILITIES
AI GOVERNANCE LEADERSHIP ADVISORY
-
Advise executive leaders on highly complex AI technology capabilities and risks as they relate to operations, workers, and customers, providing recommendations that influence policies, programs, and projects. (e.g., responsible AI use policies, AI impact assessments, AI procurement and adoption protocols, AI inventory tracking best practices, 3rd party AI value chain validation and auditing methodologies, etc.).
-
Secure leadership buy-in and stakeholder consensus to implement responsible AI governance strategies and supporting organizational structures.
-
Conduct risk-benefit trade-off evaluations for ROI considerations and impacts of AI use case selection.
-
Utilize strategic methods to prioritize AI use case in order to maximize the value of the limited organizational resources.
-
Apply advanced technical knowledge of high-risk artificial intelligence products and service delivery to conduct risk mitigation assessments, plan mitigation control tactics, evaluate data efficacy, develop model management processes, establish monitoring resources needs, and implement compliance strategies.
AI GOVERNANCE OPERATIONALIZATION
-
Develop and leverage the Risk Management Framework for Procuring AI Solutions RMF PAIS 1.0) to establish responsible acquisition of AI solutions including risk appetite analysis techniques, risk assessment and prioritization practices, treatment and control methods, team consensus building protocols, and stakeholder engagement feedback loops.
-
Assist with refining and implementing appropriate policies, processes, and practices, the development and delivery of ethical choice coaching, and annual training; institutionalize continuous monitoring and reporting; and systematize the use of diverse stakeholder inclusion strategies and operational routines.
-
Deploy user-centered and iterative methodologies to develop and implement inclusive change management strategies and approaches including scoping and anticipating employee engagement needs and concerns, user acceptance testing, generating buy-in through employee explanation sessions, and setting clear deployment expectations.
AI RESEARCH
-
Establish and guide the organization’s research agenda to ensure output is relevant, high-quality, insightful, and scholarly in order to effectively contribute to the field of AI literacy and understanding and serve as the basis of the organization’s educational products.
-
Investigate, analyze, develop, review, and test a broad catalog of AI audit criteria and corresponding independent auditing best practices to ensure use cases, legal requirements, and best practices in AI governance and risk mitigation are clearly defined, fair, trustworthy, practical, implementable, and support the rights of all stakeholders.
AI EDUCATION AND TRAINING
-
Develop, test, iterate, and deliver curricula, online courses, and in-person workshops on topics related to responsible and ethical AI procurement, AI technology in human resources, inclusive change management, organizational governance of high-risk AI systems, and AI and data literacy.
-
Provide input, research, and educational background briefings to legislators in an effort to establish responsible AI policies, laws, regulations, and standards.
AI Procurement Lab – Lewes, DE
AI Procurement Lab is a 501(c)3 non-profit research and training organization focused on responsible procurement of AI solutions.
Co-founder / Director - 02/2024 to Present
Advise peers and colleagues, conduct research, and develop best practices, guidance, and tools to foster responsible procurement of high-risk artificial intelligence and automated decision systems.
DUTIES AND RESPONSIBILITIES
PUBLIC SECTOR AI ADVISORY
-
Advise and assist leaders and officials in international, national, and local government organizations and agencies with:
-
Fundamental responsible AI policies (e.g., responsible AI, responsible use, incident management, etc.), procurement procedure alignment, and related culture change messaging.
-
AI impact needs assessment for procurement and program management workforce readiness to identify skill gaps and establish a mitigation roadmap to address the complex and ever-evolving landscape of modernizing government operations with resource limitations.
-
AI literacy planning and implementation of foundational and domain-specific AI concepts for procurement and program management professionals to facilitate skill building that aligns with the intricacies of purchasing and managing next-generation AI technologies.
-
AI RESEARCH AND STUDIES
-
Conduct ongoing research and studies to assess, validate, and deliver thought leadership in the areas of AI procurement best practices, evolutions in the AI value-chain trends, new AI use cases and product development insights, AI governance monitoring tools and solutions, and developing AI risk mitigation and management practices.
-
Identify and establish benchmarks for objectives and key results (OKRs), key performance indicators (KPIs), metrics, and measurements to monitor the performance of AI and the human oversight community including but not limited to agency procurement risk appetite scoring, AI performance metrics (e.g., F1 score, F2 score, precision at K, Dunn Index, 4/5ths, Flesch-Kincaid readability, etc.), infrastructure and stack monitoring (e.g., uptime, penetration testing, etc.), and incident and appeals monitoring (e.g., incident type, response time, etc.).
AI EDUCATION AND AWARENESS PROGRAMS
-
Collaborate with mission-aligned non-profit organizations and associations to deliver AI educational programs, lectures, workshops, discussions, and interactive sessions to a wide range of audiences in an effort to raise awareness of AI opportunities and risks, the role procurement can plan in the overall organizational AI governance strategy, and answer questions that can clear the path for wider adoption of responsible AI development and deployment.
​
Wilmington University – Wilmington, DE
Wilmington University is an accredited, private, nonprofit, higher education institution offering over 200 academic certifications, and undergraduate, graduate, and doctorate degrees.
Adjunct Instructor – 08/2024 to Present
Design and teach AI and leadership courses for doctorate-level students in the Business Administration program.
DUTIES AND RESPONSIBILITIES
-
Create and manage syllabi that meet department and college requirements.
-
Teaching classes, lead discussions, create assignments, assess student performance to ensure learning objectives are achieved for each student.
-
Collaborate with colleagues to incorporate cross-cutting AI concepts into course curricula as needed.
The Great STEMporium - Lewes, DE
The Great STEMporium was a science activity center focused on providing hands-on science, technology, engineering, and math (STEM) educational programming for students. [This organization was shuttered due to Covid.]
Founder / Chief Innovation Officer - 01/2018 to 10/2020
Designed and developed interactive STEM programming for students and parents to encourage a deeper interest in STEM to take root at the earliest possible ages.
DUTIES AND RESPONSIBILITIES
-
Established and administered policies, processes, and practices related to human resources, information technology platforms, quality assurance, procurement, sales, marketing, customer care, and accounting.
-
Identified market opportunities, sourced funds, established new lines of business, selected strategic partners, and determined the strategic direction of the firm.
-
Developed, tested, iterated, and delivered hands-on STEM curriculum for all levels of learners - online and in-person, ensuring all diversity and inclusivity goals and objectives were incorporated into curricula designs.
-
Assess user needs and conducted user experience and user acceptance testing including identifying and segmenting stakeholders, designing pass/fail test parameters, establishing reliable qualitative feedback loops, and carrying out iterative reviews.
Summit Group– Silver Spring, MD
Summit Group, LLC is a multi-disciplinary marketing firm focused on research, branding, digital presence, and e-commerce solutions for a variety of B2B and B2C clients.
VP, Marketing & Innovation - 01/2012 to 12/2018
Provided strategic advisory to leadership and colleagues on internal innovation initiatives, conducted research, and developed best practices and change management guidance to maximize organizational value and user satisfaction.
DUTIES AND RESPONSIBILITIES
TECHNICAL LEADERSHIP
-
Serve as a senior executive leader overseeing the development and governance of a proprietary, multi-tenant e-commerce platform hosting 150+ sites serving B2B/B2C/B2G clients.
-
Establish and steer the product roadmap including aligning product vision, strategy, and objectives, determining technical and functional project scoping and prioritization, and establishing development, testing, and release policies.
COMPLEX IT PLATFORM OVERSIGHT
-
Serve as the Scrum product owner utilizing PMI, Agile, and PMP disciplines to ensure resources were fairly, responsibly, and effectively deployed to achieve agreed-upon timelines.
-
Lead and coordinate cross-functional teams consisting of software engineers, data specialists, designers, product managers, client services, logistics, and accounting to meet program or project goals, objectives, and priorities in the technology platform product roadmap
-
Orchestrate highly complex technical and interoperable tasks including ERP integrations, POS integrations for multi-channel sales, UX design (including WCAG accessibility compliance), user experience testing and refinements, pre- and post-launch data integrity issues, inventory procurement strategy and analytics, demand generation strategies, post-launch quality control and risk management, staff and client training, and post-launch metrics monitoring and development, SLA, KPI, and financial strategies.
DATA GOVERNANCE AND ANALYTICS
-
Accountable for governing, analyzing, benchmarking, utilizing, and monitoring a wide variety of data types, formats, and modalities residing in disparate systems and data platforms including:
-
Sales data (150+ web properties)
-
Implementation metrics (50k+ annual labor hours)
-
Supply chain data (500k+ skus, 1800+ suppliers, 150+ web properties)
-
Logistics data (1M+ transactions annually)
-
Call center data (15+ CSR's, 75+ inbound lines, 250+ inbound email addresses)
-
Help desk data (150+ web properties)
-
P&L data (150+ P&Ls, 12 shared corporate cost centers)
-
Digital marketing data (150+ web properties) - Google Analytics, Google AdWords, SEOmoz, keywords, backlinks, reputation, SERP’s, schema, email campaign analytics
-
Spottsworth Consulting Group – Silver Spring, MD
Spottsworth Consulting Group specializes in organizational strategy and implementation services for a variety of clients.
Executive Director - 10/2011 to 11/2012
Conducted strategic consulting for leadership on digital transformation initiatives, mapped and redesigned organizational processes, and developed best practices and change management guidance to maximize organizational value and user satisfaction.
CORPORATE STRATEGY AND CHANGE MANAGEMENT
-
Conduct strategic position evaluation, strategic option evaluation and prioritization, and collaborative strategic plan development.
-
Coach executives, directors, and managers on data literacy, and quantitative and qualitative data analysis to establish new norms, policies, and allocation methodologies.
-
Implement change management planning and practices.
ENTERPRISE OPERATIONS SYSTEM IMPLEMENTATIONS
-
Provide consulting and augmented project management support on system implementations for Oracle, Salesforce.com, Insightly, Method CRM, HubSpot, Happy Fox, and WordPress.
LMS DEVELOPMENT AND IMPLEMENTATIONS
-
Provide strategic consulting on the ground-up development of two proprietary learning management systems (LMS) platforms utilized by students in the university market.
-
Implement complex and custom configurations of commercial off-the-shelf LMS solutions including Canvas, Schoology, and Articulate.
PAY AND COMPENSATION PLAN OVERHAUL
-
Provide root cause analysis, problem articulation, data science support, and solution mapping to convert 30+ fully commissioned account executives to a new compensation structure resulting in significant revisions to enterprise planning systems and cross-departmental processes. The new system aligned selling behaviors with supply chain management strategies to improve supply chain performance by 240% without diminishing sales compensation paid where new behaviors were adopted.
​​
Summit Marketing – Silver Spring, MD
Summit Group, LLC is a multi-disciplinary strategic communications firm specializing in research, integrated campaigns, and e-commerce solutions for private and public organizations.
Sr Director, Government Operations - 01/2004 to 12/2012
Served as strategic operations director and contracting representative on all federal government contracts for social well-being communication programs, technology delivery projects, and research projects focused on highly sensitive subject areas.
CONTRACT AND SUBCONTRACT MANAGEMENT
-
Lead contract response processes including response writing, cost builds across six operating divisions for time and materials and firm fixed price bids, and provided sole source justification data culminating in $650M+ in contract ceiling with $200M in funded requests across 35+ task orders.
-
Monitor subcontractor performance and quality compliance across a variety of studies produced by McKenzie and Company, Gallup, and other mid- and small-size firms.
-
Fulfill requirements for all government reporting including but not limited to quality assurance surveillance plans, small business subcontracting plans, detailed invoice submissions, conformance reports, and monthly briefings to senior leadership.
GOVERNMENT CULTURE AND SOCIAL CHANGE PROGRAMS
-
Work with the various DOD and civilian agencies to:
-
Conduct research among internal government employees utilizing various research methodologies including but not limited to qualitative interviews, focus groups, open-ended surveys, quantitative surveys, and user acceptance testing for internal communications programs related to diversity and inclusion, digital transformation, employee transition, policy and process updates, and compensation and benefits updates for the purposes of establishing clear and effective change management messaging.
-
Implement internal communications campaigns for diversity, equity, and inclusion, harassment prevention, sexual assault prevention, health promotion/risk reduction, suicide prevention, alcohol prevention, and mental health stigma reduction campaigns.
WEBSITE DEVELOPMENT AND MANAGEMENT
-
Serve as project manager to setup, implement, and maintain program websites and digital presence tactics including strategic planning and content development for strategic content development, and compliance with SCHEMA, security protocols, and WCAG requirements.
Marketing Director - 01/2000 to 12/2004
Develop, plan, and execute research and marketing strategies to achieve business growth goals.
STRATEGIC PLANNING
-
Develop customer and employee journey strategies including, but not limited to SEO/SEM strategies, market penetration strategies, social media engagement strategies, content marketing strategies, messaging strategies, engagement and retention strategies, and product/benefits development strategies.
-
Conduct strategic audience segmentation based on demographic geographic, social, and lifestyle factors, and determine the statistical significance for each sample size through CHAID clustering and other segmentation techniques.
MARKETING AND COMMUNICATIONS MANAGEMENT
-
Manage business plan development, product development, branding, platform and program features, website user experience, print components, reporting, marketing campaign planning sales demo sites, and execution of turn-key recognition program.
Volunteer Work
Alexander Mann Solution (AMS) – London, England
Alexander Mann Solution (AMS) is a talent management firm providing 10,000+ experts, across 120+ countries, speaking more than 50 languages to some of the most admired organizations on earth.
AI Governance Board; 9/2024 to Present
-
Provide AI subject matter expertise and contribute to responsible AI governance oversight for the organization’s internal AI strategy and adoption practices.
​
IEEE Standards Association – Piscataway, NJ
The Institute of Electrical and Electronics Engineers (IEEE) is a professional association for electronic engineering and electrical engineering (and associated disciplines) with its corporate office in New York City and its operations center in Piscataway, New Jersey.
Vice Chair - 10/2022 to Present
-
Provide leadership within the P3119 AI Procurement standard working group
-
Contribute to the development of international consensus-based best practices, processes, tools, rubrics, and guides related to procurement and governance of AI in high-risk use cases.
AI Policy Committee Member - 5/2023 to Present
-
Contribute to the development of federal policy and legislation recommendations for ethical and responsible AI.
-
Co-chaired the AI Audit Policy subcommittee in the development of a pivotal policy position statement on how to establish an ecosystem to effectively conduct AI audits.
-
Chair the AI Education and Future Workforce Policy subcommittee in the revitalization of a policy position statement to advise legislators on K-12, higher education, and workforce development needs as they relate to essential legislative actions.
-
Participate in Open Foundation Model Policy subcommittee in the development of novel policy recommendations for safe deployment and use of downstream applications.
​
ForHumanity - Armonk, NY
ForHumanity is a 501(c)3 non-profit research and training organization focused on establishing AI audit criteria in alignment with AI laws, regulations, human rights, and responsible AI principles.
Executive Board Member; 03/2023 to Present
-
Contribute to the governance and strategic direction of ForHumanity.
Research Fellow - 02/2022 to Present
-
Conduct research on AI and contribute to the development of AI audit criteria.
​
Responsible AI Institute - Austin, TX
The Responsible AI Institute (RAI) is a non-profit organization that brings together global stakeholders to develop practical approaches to maximize the societal benefits of AI while minimizing its risks.
Research Collaborator - 06/2022 to 6/2024
-
Collaborate with a team of researchers, developers, and practitioners to develop AI audit criteria, guidelines, and best practices for the responsible development of automated employment decision tools.
Education
Wilmington University - Wilmington, DE
Doctorate in Business Administration
Concentration: AI Governance and Risk Management Dissertation
University of Maryland - College Park, MD
Masters in Business Administration
Concentration: Marketing
Frostburg State University - Frostburg, MD
Bachelor of Arts
Major: International Business
Minor: Spanish
Certifications
Certified Change Management Professional (CCMP) - Acuity Institute - Issued Dec 2022
​
Independent Auditor of AI Systems & GDPR - ForHumanity - Issued Apr 2022
​
Social and Behavioral Responsible Conduct of Research - CITI Program - Issued Jan 2023
​
Ethics of Artificial Intelligence - University of Helsinki - Issued Jan 2023
​
Ethics for Open-Source Development - The Linux Foundation - Issued Jan 2023
​
Inclusive Strategies for Open-Source Communities - The Linux Foundation - Issued Jan 2023
​
OneTrust Privacy Professional - OneTrust - Issued Apr 2022
​
Governance, Risk Management, and Compliance Professional - OneTrust - Issued Jun 2022
Honors & Awards
43 Must-Follow Women Leaders in Artificial Intelligence –- Wednesday Women - July 2024.
​
Sigma Beta Delta – International Honor Society in Business, Management, and Administration - Nov 2023.
​
100 Brilliant Women in AI Ethics - Women in AI Ethics - Dec 2022.
​
AI Policy Research with Distinction - Center for AI and Digital Policy - Dec 2022.