Abstract: As artificial intelligence (AI) becomes increasingly integrated into learning, decision-making, and knowledge work, concerns have emerged regarding automation bias, cognitive offloading, diminished critical evaluation, and the preservation of human agency. The purpose of this study was to operationalize the construct of Conscious Intelligence and develop a psychometrically sound instrument for its measurement within AI-mediated environments. Grounded in the Conscious Intelligence Integration Framework (CIIF), the study developed and evaluated the Conscious Intelligence Scale (CIS-25), comprising five dimensions: Reflective Awareness, Discernment, Metacognitive Regulation, Ethical Reasoning, and Epistemic Responsibility. A cross-sectional survey was conducted with 250 adults who reported using AI technologies at least weekly. Psychometric evaluation included content validity, internal consistency reliability, test–retest reliability, exploratory factor analysis (EFA), convergent validity, discriminant validity, and higher-order confirmatory factor analysis (CFA). Results demonstrated strong internal consistency (Cronbach’s α = .819–.842) and temporal stability (ICC = .824–.867). EFA supported a five-factor structure explaining 68.42% of the total variance. Evidence of construct validity was demonstrated through acceptable Composite Reliability (CR = .85–.90), Average Variance Extracted (AVE = .54–.64), and Heterotrait–Monotrait Ratio (HTMT = .54–.78) values. Higher-order CFA demonstrated excellent model fit (CFI = .958, TLI = .952, RMSEA = .047, SRMR = .041), supporting Conscious Intelligence as a multidimensional higher-order construct reflected by five first-order dimensions. The findings provide initial evidence supporting the reliability and validity of the CIS-25 as a measure of Conscious Intelligence in AI-mediated environments. By operationalizing Conscious Intelligence as a measurable construct, the study contributes a psychometrically supported instrument for future research examining human agency, reflective judgment, ethical reasoning, epistemic responsibility, and responsible engagement with artificial intelligence.
Keywords: Conscious Intelligence, artificial intelligence, psychometric validation, scale development, AI-mediated cognition, human agency, responsible AI engagement.
Title: Operationalizing Conscious Intelligence in AI-Mediated Environments: Development and Initial Validation of the Conscious Intelligence Scale (CIS-25)
Author: Dr. David Bull
International Journal of Social Science and Humanities Research
ISSN 2348-3156 (Print), ISSN 2348-3164 (online)
Vol. 14, Issue 2, April 2026 - June 2026
Page No: 443-467
Research Publish Journals
Website: www.researchpublish.com
Published Date: 19-June-2026
