Step 4: Full View

Entities, provisions, decisions, and narrative

Public Health, Safety, and Welfare—Driverless/Autonomous Vehicle
Step 4 of 5

247

Entities

5

Provisions

1

Precedents

17

Questions

18

Conclusions

Stalemate

Transformation
Stalemate Competing obligations remain in tension without clear resolution
Full Entity Graph
Loading...
Context: 0 Normative: 0 Temporal: 0 Synthesis: 0
Filter:
Building graph...
Entity Types
Synthesis Reasoning Flow
Shows how NSPE provisions inform questions and conclusions - the board's reasoning chain
Node Types & Relationships
Nodes:
NSPE Provisions Questions Conclusions Entities (labels)
Edge Colors:
Provision informs Question
Question answered by Conclusion
Provision applies to Entity
NSPE Code Provisions Referenced
View Extraction
I.1. I.1.

Full Text:

Hold paramount the safety, health, and welfare of the public.

Applies To:

role Engineer A Autonomous Vehicle Risk Assessment Team Engineer
Engineer A must hold paramount public safety when evaluating autonomous vehicle risk scenarios for the manufacturer.
role Engineer A Safety-Critical Software Design Engineer (Case 96-4)
Engineer A must hold paramount public safety when designing software for public-safety-critical facilities.
resource NSPE Code of Ethics
I.1 is a foundational canon of the NSPE Code of Ethics directly governing Engineer A's paramount obligation to public safety.
resource Qualitative Risk Assessment Methodology for Autonomous Vehicle Crash Scenarios
Holding public safety paramount requires Engineer A to apply rigorous risk assessment methodology to identify potential harms to passengers and pedestrians.
resource Autonomous Vehicle Operating System Safety Standard
Holding public safety paramount requires adherence to safety standards governing autonomous vehicle operating systems.
resource Draft_AV_Safety_Testing_Standard
The emerging draft standard represents the current threshold for public safety protection that Engineer A must consider when holding safety paramount.
state Engineer A Ethical Dilemma — Harm Allocation Recommendation
Engineer A's obligation to hold public safety paramount directly shapes the ethical dilemma of choosing between harm-allocating algorithms.
state Present Case Client-Interest vs Third-Party Safety Algorithmic Pre-Commitment
Holding public safety paramount requires Engineer A to weigh third-party safety against client commercial interests in algorithm design.
state Public Safety at Risk — Autonomous Vehicle Third-Party Harm
The provision directly addresses the risk of fatal or serious injury to pedestrians and cyclists from algorithm design choices.
state Competing Duties — Passenger Safety vs. Aggregate Harm Minimization
The paramount duty to public safety is the governing principle in resolving Engineer A's competing professional duties.
state Present Case Autonomous Vehicle Do No Harm Design Obligation
The do no harm design obligation is a direct expression of the paramount duty to hold public safety above all other considerations.
state Present Case Autonomous System Harm Allocation Design
Designing harm-allocation decision logic must be governed by the paramount obligation to protect public safety.
state BER Case 96-4 Public Safety at Risk from Safety-Critical Software
The risk to the public from deploying safety-critical software not meeting forthcoming standards directly implicates the paramount safety duty.
obligation Engineer A AV Risk Assessment Team Harm Minimization Participation Obligation
Holding paramount public safety directly requires active participation in harm minimization evaluation.
obligation Engineer A AV Risk Assessment Third-Party Safety Consideration Obligation
Holding paramount public safety requires explicitly identifying and assessing third-party safety risks.
obligation Engineer A AV Further Study Recommendation Before Deployment Obligation
Holding paramount public safety requires recommending further study before deploying potentially unsafe AV technology.
obligation Engineer A Autonomous Vehicle Do No Harm Obligation
The paramount safety provision directly underpins the obligation to strive to do no harm.
obligation Engineer A BER 96-4 Public Welfare Paramount Safety-Critical Software Obligation
This obligation explicitly mirrors the paramount safety provision in the context of safety-critical software testing.
principle Public Welfare Paramount Invoked in Autonomous Vehicle Crash Algorithm Design
I.1 directly embodies the paramount public welfare obligation that governs the crash algorithm design decision.
principle Public Welfare Paramount Invoked in Autonomous Vehicle Risk Assessment
I.1 is the foundational provision that establishes Engineer A's overriding responsibility to hold public safety paramount in the risk assessment.
principle Third-Party Non-Client Welfare Consideration Invoked in Autonomous Vehicle Design
I.1 requires holding paramount the welfare of all members of the public, including third parties such as pedestrians and cyclists.
principle Third-Party Non-Client Welfare Consideration Invoked in Autonomous Vehicle Case
I.1 extends the paramount safety obligation to pedestrians and bystanders who are not clients or passengers.
principle Do No Harm Obligation Invoked by Engineer A in Autonomous Vehicle Case
I.1 grounds the do no harm obligation by requiring engineers to prioritize public safety before deployment.
principle Competing Public Goods Balancing Invoked in Passenger vs. Third-Party Safety Trade-Off
I.1 requires balancing competing public goods since both passenger and third-party safety fall under the paramount public welfare mandate.
principle Algorithmic Harm Distribution Ethics Invoked in Autonomous Vehicle Case
I.1 requires that the distribution of harm embedded in the algorithm be evaluated against the standard of paramount public welfare.
action Recommend Additional Safety Testing
Holding public safety paramount directly governs recommending further safety testing before deployment.
action Actively Participate in Risk Assessment
Paramount duty to public safety requires active engagement in identifying and assessing risks.
action Unambiguously Express Safety Concerns
Holding public safety paramount obligates engineers to clearly voice safety concerns.
action Propose Further Study Before Deployment
Prioritizing public welfare governs proposing additional study to ensure safe deployment.
event Safety-Critical Software Identified
Identifying safety-critical software directly invokes the paramount duty to protect public safety.
event Unavoidable Crash Scenario Identified
An unavoidable crash scenario directly threatens public safety and welfare, triggering the paramount obligation.
event Algorithmic Ethics Gap Recognized
A gap in algorithmic ethics in an AV system poses a direct risk to public health and safety.
event Financial Pressure on Testing
Allowing financial pressure to compromise testing undermines the paramount duty to protect public safety.
capability Engineer A AV Public Transparency Advocacy Capability
Holding public safety paramount requires transparency about moral frameworks encoded in AV algorithms that affect public welfare.
capability Engineer A AV Third-Party Harm Weighting Capability
Holding public safety paramount directly requires assessing and weighing the welfare interests of third parties such as pedestrians and cyclists.
capability Engineer A AV Crash Scenario Technical Safety Analysis Capability
Holding public safety paramount requires technical analysis of unavoidable crash scenarios to protect the public from harm.
capability Engineer A AV Harm Minimization Risk Management Participation
Active participation in risk assessment is a direct expression of holding public safety paramount in AV development.
capability Engineer A Autonomous Vehicle Do No Harm Novel Technology Application Capability
The do-no-harm principle is a direct operationalization of holding public safety and welfare paramount.
capability Engineer A AV Risk Assessment Active Participation Capability
Fully participating in risk management to clearly articulate safety concerns is required by the obligation to hold public safety paramount.
capability Engineer A Public Welfare Paramountcy Safety-Critical Software Capability
Recognizing the enormous public impact of safety-critical software industries directly reflects the requirement to hold public welfare paramount.
capability Engineer A Regulatory Gap Safety Escalation Software Standards Capability
Recognizing that a regulatory gap heightens safety obligations is a direct application of holding public safety paramount.
constraint Engineer A AV Harm Allocation Moral Framework Non-Deception Public Disclosure Constraint
Holding public safety paramount requires not deploying an AV with an undisclosed moral framework that could harm the public.
constraint Engineer A AV Good Faith Safety Concern Objective Testimony Constraint
Paramount public safety obligation requires Engineer A to disclose safety concerns in good faith even absent established standards.
constraint Engineer A AV Do No Harm Design Obligation Safety Constraint
The do no harm design obligation directly flows from the paramount duty to protect public safety and welfare.
constraint Engineer A BER 96-4 Public Safety Paramount Safety-Critical Software Constraint
This constraint explicitly invokes the paramount public safety obligation over business considerations in safety-critical software.
constraint Engineer A AV Regulatory Standards Vacuum Heightened Disclosure Constraint
Absence of standards heightens rather than diminishes the paramount duty to protect the public from AV harm-allocation risks.
constraint Engineer A AV Passenger Priority Algorithm Third-Party Fatal Harm Non-Subordination Constraint
Holding public safety paramount prohibits algorithms that categorically sacrifice third-party lives, as the public includes non-passengers.
constraint Engineer A AV Further Study Before Deployment Constraint
Paramount public safety requires recommending further study before deploying an AV system with unresolved safety concerns.
constraint Engineer A AV Client Interest Third-Party Safety Priority Constraint
The paramount public safety duty establishes that third-party safety takes priority over client commercial interests.
constraint Engineer A AV Do No Harm Deployment Constraint
The do no harm deployment constraint is a direct expression of the paramount obligation to protect public safety before deployment.
constraint Engineer A AV Risk Mitigation Option Exploration Constraint
Paramount public safety requires exhausting all risk mitigation options before recommending deployment of a potentially harmful AV system.
constraint Engineer A AV Active Participation Concern Expression Constraint
Holding public safety paramount obligates active rather than passive participation in safety processes affecting the public.
constraint Engineer A AV Further Study Recommendation Constraint
Paramount public safety duty requires Engineer A to vocalize the need for further study when safety concerns remain unresolved.
II.1. II.1.

Full Text:

Engineers shall hold paramount the safety, health, and welfare of the public.

Applies To:

role Engineer A Autonomous Vehicle Risk Assessment Team Engineer
Engineer A is professionally obligated to prioritize public safety, health, and welfare in the autonomous vehicle risk assessment.
role Engineer A Safety-Critical Software Design Engineer (Case 96-4)
Engineer A must hold paramount public safety when aware that safety-critical software may not conform to new draft standards.
resource NSPE Code of Ethics
II.1 is a direct provision of the NSPE Code of Ethics establishing Engineer A's core professional obligation to public safety.
resource ISO 26262 Automotive Functional Safety Standard
Holding public safety paramount in automotive engineering requires conformance with ISO 26262 as the governing functional safety standard.
resource Qualitative Risk Assessment Methodology for Autonomous Vehicle Crash Scenarios
Engineer A's obligation to hold public safety paramount necessitates use of structured risk assessment methodology to evaluate crash scenarios.
resource Consumer Product Safety Testing Standard for Autonomous Vehicles
Holding public safety paramount requires Engineer A to consider applicable consumer product safety testing standards before market release.
resource BER_Case_96-4
This precedent case establishes the principle that holding safety paramount obligates engineers to recommend additional testing when safety standards may not be met.
state Engineer A Ethical Dilemma — Harm Allocation Recommendation
The professional duty to hold public safety paramount is the central ethical obligation framing Engineer A's dilemma.
state Present Case Client-Interest vs Third-Party Safety Algorithmic Pre-Commitment
This provision requires Engineer A to prioritize third-party safety over the client's preference for passenger-protective algorithms.
state Autonomous Vehicle Harm Allocation Design Assignment
Engineer A's assignment to evaluate harm-allocation logic must be conducted under the overriding duty to protect public safety.
state Public Safety at Risk — Autonomous Vehicle Third-Party Harm
The provision directly governs Engineer A's response to the identified risk of harm to pedestrians and cyclists.
state Competing Duties — Passenger Safety vs. Aggregate Harm Minimization
This provision establishes that public welfare is paramount and must take precedence when Engineer A's duties conflict.
state Present Case Autonomous Vehicle Do No Harm Design Obligation
The do no harm obligation is a direct application of the duty to hold public safety paramount in system design.
state Present Case Autonomous System Harm Allocation Design
The design of autonomous harm-allocation logic must conform to the overriding professional duty to protect public safety.
state BER Case 96-4 Public Safety at Risk from Safety-Critical Software
Deployment of safety-critical software posing public risk directly triggers the paramount duty under this provision.
obligation Engineer A AV Risk Assessment Team Harm Minimization Participation Obligation
Holding paramount public safety, health, and welfare requires full participation in harm minimization assessments.
obligation Engineer A AV Risk Assessment Third-Party Safety Consideration Obligation
Holding paramount public welfare requires explicitly considering third-party safety impacts in risk assessments.
obligation Engineer A AV Further Study Recommendation Before Deployment Obligation
Holding paramount public safety requires recommending further study before AV deployment if risks remain unresolved.
obligation Engineer A Autonomous Vehicle Do No Harm Obligation
The obligation to hold public welfare paramount directly supports the duty to strive to do no harm.
obligation Engineer A BER 96-4 Public Welfare Paramount Safety-Critical Software Obligation
This obligation is a direct application of the paramount public welfare provision to safety-critical software decisions.
principle Public Welfare Paramount Invoked in Autonomous Vehicle Crash Algorithm Design
II.1 reiterates the paramount public safety obligation directly applicable to the crash algorithm design evaluation.
principle Public Welfare Paramount Invoked in Autonomous Vehicle Risk Assessment
II.1 is the operative code provision establishing Engineer A's overriding ethical responsibility in the risk assessment context.
principle Third-Party Non-Client Welfare Consideration Invoked in Autonomous Vehicle Design
II.1 mandates holding paramount the welfare of the public, which explicitly includes third parties beyond the client relationship.
principle Third-Party Non-Client Welfare Consideration Invoked in Autonomous Vehicle Case
II.1 extends the paramount safety duty to all members of the public including pedestrians and bystanders.
principle Do No Harm Obligation Invoked by Engineer A in Autonomous Vehicle Case
II.1 supports the do no harm obligation by requiring engineers to prioritize public safety before system deployment.
principle Competing Public Goods Balancing Invoked in Passenger vs. Third-Party Safety Trade-Off
II.1 requires that both passenger and third-party welfare be weighed under the paramount public safety standard.
principle Algorithmic Harm Distribution Ethics Invoked in Autonomous Vehicle Case
II.1 requires that harm distribution decisions in the algorithm be evaluated against the paramount public welfare obligation.
principle Active Risk Assessment Team Participation Obligation Invoked by Engineer A
II.1 requires Engineer A to actively participate and clearly express views to ensure public safety is held paramount within the team.
action Recommend Additional Safety Testing
The duty to hold public safety paramount governs recommending additional testing to mitigate risks.
action Actively Participate in Risk Assessment
Engineers must hold public safety paramount, which requires active participation in risk assessment processes.
action Unambiguously Express Safety Concerns
This provision obligates engineers to clearly express safety concerns to protect the public.
action Propose Further Study Before Deployment
Holding public welfare paramount governs proposing further study before a potentially unsafe deployment.
event Safety-Critical Software Identified
Engineers must hold public safety paramount when safety-critical software issues are discovered in AV development.
event Unavoidable Crash Scenario Identified
Engineers are obligated to prioritize public welfare when a crash scenario with potential harm is identified.
event Algorithmic Ethics Gap Recognized
Recognizing an ethics gap in AV algorithms requires engineers to uphold public safety above other interests.
event Financial Pressure on Testing
Engineers must hold public safety paramount even when facing financial pressure to reduce testing rigor.
capability Engineer A AV Public Transparency Advocacy Capability
Engineers must hold public welfare paramount, which includes advocating transparency about AV harm minimization algorithms affecting the public.
capability Engineer A AV Third-Party Harm Weighting Capability
Holding public welfare paramount requires explicitly identifying and assessing harm to third parties who are members of the public.
capability Engineer A AV Crash Scenario Technical Safety Analysis Capability
Engineers must hold public safety paramount, requiring rigorous technical analysis of crash scenarios that could harm the public.
capability Engineer A AV Harm Minimization Risk Management Participation
Full participation in risk management directly fulfills the engineer's duty to hold public safety paramount.
capability Engineer A Autonomous Vehicle Do No Harm Novel Technology Application Capability
Applying the do-no-harm principle to AV systems is a direct expression of the duty to hold public welfare paramount.
capability Engineer A AV Risk Assessment Active Participation Capability
Active and clear participation in risk assessment is required to fulfill the duty to hold public safety paramount.
capability Engineer A Public Welfare Paramountcy Safety-Critical Software Capability
Recognizing the public impact of safety-critical software is directly tied to the duty to hold public welfare paramount.
capability Engineer A Regulatory Gap Safety Escalation Software Standards Capability
Escalating safety concerns when regulatory standards are absent reflects the duty to hold public safety paramount.
constraint Engineer A AV Harm Allocation Moral Framework Non-Deception Public Disclosure Constraint
Paramount public safety obligation requires disclosure of embedded moral frameworks that could affect public welfare in AV deployment.
constraint Engineer A AV Good Faith Safety Concern Objective Testimony Constraint
The duty to hold public safety paramount requires objective good-faith testimony about safety concerns regardless of regulatory gaps.
constraint Engineer A AV Do No Harm Design Obligation Safety Constraint
The paramount safety obligation underpins the do no harm design requirement for autonomous vehicle systems.
constraint Engineer A BER 96-4 Public Safety Paramount Safety-Critical Software Constraint
This constraint directly references the paramount public safety obligation as overriding business pressures in safety-critical software decisions.
constraint Engineer A AV Regulatory Standards Vacuum Heightened Disclosure Constraint
The paramount safety duty is heightened, not diminished, when regulatory standards are absent for AV harm-allocation logic.
constraint Engineer A AV Passenger Priority Algorithm Third-Party Fatal Harm Non-Subordination Constraint
Paramount public safety encompasses third parties, prohibiting algorithms that categorically subordinate their lives to passengers.
constraint Engineer A AV Further Study Before Deployment Constraint
The paramount safety obligation requires recommending further study before deploying an AV system with unresolved harm-allocation concerns.
constraint Engineer A AV Client Interest Third-Party Safety Priority Constraint
Paramount public safety establishes that third-party safety supersedes client commercial interests when they conflict.
constraint Engineer A AV Do No Harm Deployment Constraint
The do no harm deployment constraint is grounded in the paramount duty not to expose the public to preventable AV-related harm.
constraint Engineer A AV Risk Mitigation Option Exploration Constraint
Paramount public safety requires exploring all risk mitigation options before recommending deployment of a potentially unsafe AV system.
constraint Engineer A AV Active Participation Concern Expression Constraint
The paramount safety duty requires active expression of safety concerns rather than passive silence in risk management processes.
constraint Engineer A AV Further Study Recommendation Constraint
Paramount public safety obligates Engineer A to recommend further study when unresolved safety concerns exist about the AV system.
II.1.b. II.1.b.

Full Text:

Engineers shall approve only those engineering documents that are in conformity with applicable standards.

Applies To:

role Engineer A Autonomous Vehicle Risk Assessment Team Engineer
Engineer A should only approve engineering documents for the autonomous vehicle that conform to applicable standards.
role Engineer A Safety-Critical Software Design Engineer (Case 96-4)
Engineer A must ensure the safety-critical software design conforms to applicable standards including newly emerging draft standards.
resource ISO 26262 Automotive Functional Safety Standard
II.1.b requires approval only of documents conforming to applicable standards, directly implicating ISO 26262 as the governing automotive safety standard.
resource Autonomous Vehicle Operating System Safety Standard
Engineer A may only approve engineering documents if the autonomous vehicle operating system conforms to applicable safety standards.
resource Consumer Product Safety Testing Standard for Autonomous Vehicles
Engineering documents must conform to applicable consumer product safety testing standards before Engineer A can approve them.
resource Draft_AV_Safety_Testing_Standard
The draft standard represents an applicable standard that engineering documents must conform to, triggering Engineer A's obligation under II.1.b.
resource Software_Safety_Testing_Standard_BER96-4_Context
The existence of a new draft standard that existing software may not meet directly triggers the conformity requirement under II.1.b.
state Autonomous Vehicle Ethics Regulatory Standards Vacuum
The absence of applicable standards creates a direct challenge to Engineer A's obligation to approve only conforming engineering documents.
state Present Case Regulatory Standards Vacuum for Autonomous Vehicle Ethics
The lack of established national or industry standards means Engineer A cannot confirm conformity with applicable standards for harm-allocation logic.
state BER Case 96-4 Emerging Software Standard Pre-Adoption Gap
Engineer A's awareness of forthcoming but not yet adopted standards raises the question of which standards engineering documents must conform to.
state BER Case 96-4 Completed Safety Testing with Residual Concern
Passing existing standards while forthcoming standards remain unadopted creates ambiguity about whether engineering documents are fully conforming.
obligation Engineer A BER 96-4 Technical Report Preparation Obligation
Approving only conforming engineering documents relates directly to the obligation to prepare a technically sound report referencing applicable testing standards.
obligation Engineer A AV Faithful Agent Informed Decision Enablement Obligation
Ensuring engineering documents conform to applicable standards supports providing the manufacturer with diligent and complete information for informed decisions.
principle Regulatory Gap Safety Escalation Obligation Invoked in Software Testing Case
II.1.b requires conformity with applicable standards, directly grounding the obligation to escalate when new draft standards may not be met.
principle Do No Harm Obligation Invoked by Engineer A in Software Testing Case
II.1.b supports the do no harm obligation by prohibiting approval of documents that do not conform to applicable standards.
principle Good Faith Safety Concern Threshold Invoked in Software Testing Case
II.1.b establishes that awareness of potential non-conformity with standards is sufficient to trigger an obligation to act.
principle Autonomous System Moral Framework Transparency Obligation Invoked in AV Design
II.1.b requires that engineering documents and designs conform to applicable standards, supporting transparency about the moral framework embedded in the system.
action Prepare Transparent Technical Report
Engineers must approve only documents conforming to applicable standards, governing the preparation of accurate and transparent technical reports.
action Recommend Additional Safety Testing
Approving only conforming engineering documents governs recommending testing to ensure standards compliance.
event Draft Safety Standards Emerge
Engineers should only approve engineering documents and designs that conform to the emerging applicable safety standards.
event Safety-Critical Software Identified
Engineers must ensure safety-critical software documentation conforms to applicable standards before approval.
event Autonomous Vehicle AV OS Development Initiated
The initiation of AV OS development requires that all engineering documents conform to applicable standards.
capability Engineer A AV Crash Scenario Technical Safety Analysis Capability
Approving only conforming engineering documents requires technical analysis of crash scenarios against applicable safety standards.
capability Engineer A Safety-Critical Software Informed Employer Decision Enablement Capability
Preparing a technical report referencing draft testing protocols directly relates to approving documents in conformity with applicable standards.
capability Engineer A Regulatory Gap Safety Escalation Software Standards Capability
Recognizing that a new draft testing standard exists and affects approval obligations directly relates to conformity with applicable standards.
capability Engineer A Cross-Case Analogical Transfer BER 96-4 to AV Case Capability
Applying established ethical principles from prior cases to AV software standards supports the requirement to conform engineering documents to applicable standards.
capability Engineer A Public Welfare Paramountcy Safety-Critical Software Capability
Recognizing industry-specific safety standards for safety-critical software is relevant to the obligation to approve only conforming engineering documents.
constraint Engineer A AV Harm Allocation Algorithm Completeness Disclosure Constraint
Approving only conforming engineering documents requires that the harm-allocation algorithm recommendation be complete and fully disclosed to the risk assessment team.
constraint Engineer A BER 96-4 Emerging Standard Technical Report Disclosure Constraint
The obligation to conform to applicable standards requires disclosing newly reported draft testing standards that the AV system may not meet.
constraint Engineer A AV Regulatory Standards Vacuum Heightened Disclosure Constraint
The absence of applicable standards creates a heightened disclosure obligation rather than permitting approval of documents without conformity review.
constraint Engineer A AV Good Faith Safety Concern Objective Testimony Constraint
Approving only conforming engineering documents requires objective disclosure of safety concerns when no applicable standards exist to confirm conformity.
constraint Engineer A AV Do No Harm Design Obligation Safety Constraint
The requirement to approve only conforming documents supports the do no harm design obligation by preventing approval of non-conforming harm-allocation designs.
II.3.b. II.3.b.

Full Text:

Engineers may express publicly technical opinions that are founded upon knowledge of the facts and competence in the subject matter.

Applies To:

role Engineer A Autonomous Vehicle Risk Assessment Team Engineer
Engineer A may publicly express technical opinions on autonomous vehicle risks based on their knowledge and competence from the risk assessment work.
role Engineer A Safety-Critical Software Design Engineer (Case 96-4)
Engineer A may publicly express technical opinions on software safety standards based on their expertise and testing experience.
resource Qualitative Risk Assessment Methodology for Autonomous Vehicle Crash Scenarios
Expressing founded technical opinions requires Engineer A to base public statements on competent risk assessment methodology and factual analysis.
resource NSPE_Code_of_Ethics_Sections_III6b_II4a
The Board cited related Code sections requiring Engineer A to prepare a technical report, which supports the competence-based public expression required by II.3.b.
state Engineer A Ethical Dilemma — Harm Allocation Recommendation
Engineer A's recommendation must be grounded in factual knowledge and subject-matter competence, as required by this provision.
state Present Case Client-Interest vs Third-Party Safety Algorithmic Pre-Commitment
Engineer A's public or professional expression of a technical opinion on algorithm design must be founded on competence and facts.
state Autonomous Vehicle Harm Allocation Design Assignment
Engineer A's evaluation and recommendation on harm-allocation logic constitutes a technical opinion requiring competence and factual grounding.
state BER Case 96-4 Multi-Factor Business-Safety Balancing
Formulating a technical recommendation amid financial pressures must still be grounded in competence and knowledge of the facts.
obligation Engineer A Autonomous Vehicle Risk Assessment Active Participation Obligation
Expressing technical opinions founded on knowledge and competence supports the obligation to clearly articulate concerns during risk management participation.
obligation Engineer A AV Moral Framework Public Transparency Recommendation Obligation
Publicly expressing technically founded opinions relates to recommending transparency about the AV moral framework to the public.
obligation Engineer A BER 96-4 Technical Report Preparation Obligation
Expressing technically founded opinions supports the obligation to prepare a report grounded in current testing analysis and results.
principle Completeness and Non-Selectivity in Advisory Opinions Invoked by Engineer A Risk Assessment Team
II.3.b requires that publicly expressed technical opinions be founded on knowledge and competence, supporting the obligation to present both frameworks completely and objectively.
principle Professional Competence in Risk Assessment Invoked for Autonomous Vehicle Scenario
II.3.b requires that technical opinions be grounded in competence in the subject matter, directly applicable to the risk assessment team's specialized analysis.
principle Informed Decision-Making Enablement Obligation Invoked for Automobile Manufacturer Client
II.3.b supports the obligation to provide technically founded opinions that enable the manufacturer to make an informed decision.
principle Informed Decision-Making Enablement Obligation Invoked in Software Testing Case
II.3.b supports Engineer A's obligation to prepare a technically grounded report enabling informed decision-making by the employer.
principle Technical Recommendation Independence from Business Considerations Invoked in Software Testing Case
II.3.b requires that technical opinions be founded on knowledge and competence, not on financial or business considerations.
principle Autonomous System Moral Framework Transparency Obligation Invoked in AV Design
II.3.b supports the obligation to transparently communicate the moral framework embedded in the system based on competence and factual knowledge.
action Prepare Transparent Technical Report
Expressing technical opinions publicly must be founded on facts and competence, directly governing transparent technical reporting.
action Unambiguously Express Safety Concerns
This provision governs public expression of safety concerns, requiring they be grounded in knowledge and competence.
event Unavoidable Crash Scenario Identified
Engineers may publicly express technical opinions about unavoidable crash scenarios based on their factual knowledge and competence.
event Algorithmic Ethics Gap Recognized
Engineers with competence in AV systems may publicly express opinions about identified algorithmic ethics gaps.
event Draft Safety Standards Emerge
Engineers may publicly comment on emerging draft safety standards when they have relevant knowledge and expertise.
capability Engineer A AV Public Transparency Advocacy Capability
Publicly advocating transparency about AV algorithms constitutes expressing a technical opinion that must be founded on knowledge and competence.
capability Engineer A AV Crash Scenario Technical Safety Analysis Capability
Expressing technical opinions about crash scenarios publicly requires the competence and factual knowledge mandated by this provision.
capability Engineer A AV Ethical Framework Selection Capability
Publicly expressing opinions about the ethical framework encoded in AV systems requires competence in the subject matter as required by this provision.
capability Engineer A AV Further Study Recommendation Capability
Recommending further study publicly on unresolved safety concerns constitutes a technical opinion that must be grounded in knowledge and competence.
constraint Engineer A AV Good Faith Safety Concern Objective Testimony Constraint
Expressing technical opinions founded on knowledge and competence directly supports the obligation to provide objective good-faith testimony about AV safety concerns.
constraint Engineer A AV Harm Allocation Moral Framework Non-Deception Public Disclosure Constraint
The provision permits Engineer A to publicly express technically grounded opinions about the undisclosed moral framework embedded in the AV system.
constraint Engineer A BER 96-4 Emerging Standard Technical Report Disclosure Constraint
Expressing competence-based technical opinions supports the obligation to disclose newly reported draft standards relevant to the AV system.
constraint Engineer A AV Regulatory Standards Vacuum Escalation Permissibility Constraint
The provision supports Engineer A's permissibility to escalate concerns publicly when no regulatory standards exist and internal processes are insufficient.
constraint Engineer A AV Active Participation Concern Expression Constraint
The provision grounds the obligation to actively express safety concerns by requiring that such expressions be founded on knowledge and competence.
constraint Engineer A AV Further Study Recommendation Constraint
Expressing technically founded opinions supports the obligation to recommend further study when competence-based assessment identifies unresolved safety concerns.
III.1.b. III.1.b.

Full Text:

Engineers shall advise their clients or employers when they believe a project will not be successful.

Applies To:

role Engineer A Autonomous Vehicle Risk Assessment Team Engineer
Engineer A must advise the automobile manufacturer if the autonomous vehicle project or specific scenarios present unacceptable risks or will not be successful.
role Engineer A Safety-Critical Software Design Engineer (Case 96-4)
Engineer A must advise the software company employer if the software project will not meet safety standards and therefore will not be successful.
resource Qualitative Risk Assessment Methodology for Autonomous Vehicle Crash Scenarios
Engineer A's obligation to advise the client of project failure risk is grounded in the risk assessment findings that indicate potential safety shortfalls.
resource Draft_AV_Safety_Testing_Standard
The draft standard's requirements that the system may not meet constitute the basis for advising the client that the project may not be successful.
resource BER_Case_96-4
This precedent establishes that engineers must advise clients to conduct additional testing when a new standard may not be met, directly supporting III.1.b.
resource Software_Safety_Testing_Standard_BER96-4_Context
The triggering condition of a new draft standard the software may not meet is precisely the situation requiring Engineer A to advise the client under III.1.b.
state Passenger Safety vs. Third-Party Harm Minimization Algorithm Conflict
Engineer A must advise the automobile manufacturer client when the preferred passenger-protective algorithm conflicts with broader safety obligations.
state Client Relationship — Engineer A and Automobile Manufacturer
The active consulting relationship creates a direct obligation for Engineer A to advise the client when the project direction raises safety concerns.
state BER Case 96-4 Multi-Factor Business-Safety Balancing
Engineer A's obligation to advise the client about safety concerns applies even when significant financial pressures favor a different course.
state BER Case 96-4 Completed Safety Testing with Residual Concern
Engineer A's residual concern about forthcoming standards triggers the duty to advise the client that the project may not meet future requirements.
state Competing Duties — Passenger Safety vs. Aggregate Harm Minimization
When client interests conflict with public safety obligations, Engineer A must advise the client of the concern rather than silently comply.
obligation Engineer A Autonomous Vehicle Further Study Recommendation Obligation
Advising clients when a project will not be successful directly supports the obligation to propose further study when concerns remain unresolved.
obligation Engineer A BER 96-4 Additional Testing Recommendation Obligation
Advising the client that additional testing is required aligns with the obligation to recommend further testing and explain why it is needed.
obligation Engineer A BER 96-4 Business Pressure Non-Subordination Obligation
Advising clients based on technical findings rather than financial pressures directly supports the obligation not to subordinate recommendations to business pressure.
obligation Engineer A AV Faithful Agent Informed Decision Enablement Obligation
Acting as a faithful agent by providing complete information enables the client to make informed decisions, consistent with advising them when a project may not succeed.
principle Faithful Agent Obligation Within Ethical Limits Invoked for Engineer A Consultant Role
III.1.b establishes the faithful agent duty to advise clients honestly, which bounds Engineer A's consultant obligation within ethical limits.
principle Informed Decision-Making Enablement Obligation Invoked for Automobile Manufacturer Client
III.1.b directly requires Engineer A to advise the manufacturer client when the project may not be successful, enabling informed decision-making.
principle Graduated Internal Escalation Before External Reporting Invoked in Software Testing Case
III.1.b supports the obligation to first advise the employer internally about project concerns before considering external escalation.
principle Active Risk Assessment Team Participation Obligation Invoked by Engineer A
III.1.b requires Engineer A to clearly advise the client or employer of concerns, supporting the obligation to fully and unambiguously participate in the risk management team.
principle Do No Harm Obligation Invoked by Engineer A in Autonomous Vehicle Case
III.1.b supports the do no harm obligation by requiring Engineer A to advise the manufacturer if the autonomous vehicle system is not ready for safe deployment.
principle Regulatory Gap Safety Escalation Obligation Invoked in Software Testing Case
III.1.b requires advising the client or employer when a project may not succeed, directly applicable when new standards may not be met.
action Unambiguously Express Safety Concerns
Engineers must advise clients when a project will not be successful, governing the unambiguous expression of safety concerns to employers.
action Explore Additional Technical Mitigation Options
Advising clients of project risks governs exploring mitigation options to address identified deficiencies.
action Propose Further Study Before Deployment
The duty to advise clients when a project will not be successful governs proposing further study before deployment.
event Financial Pressure on Testing
Engineers must advise employers when financial pressure on testing will likely cause the project to fail or be unsafe.
event Safety-Critical Software Identified
Engineers should advise clients or employers when identified safety-critical software issues indicate the project will not succeed safely.
event Unavoidable Crash Scenario Identified
Engineers are obligated to advise employers when an unavoidable crash scenario signals the project cannot succeed as planned.
event Algorithmic Ethics Gap Recognized
Engineers must advise their employer when a recognized algorithmic ethics gap indicates the AV project will not be successful or safe.
capability Engineer A Faithful Agent Informed Decision Enablement Capability
Structuring and presenting professional analysis to the manufacturer directly fulfills the duty to advise clients when a project may not be successful.
capability Engineer A AV Further Study Recommendation Capability
Recommending further study when safety concerns are unresolved is a form of advising the employer that the project may not be successful as currently designed.
capability Engineer A Safety-Critical Software Informed Employer Decision Enablement Capability
Preparing a technical report on testing analysis and results to inform the employer directly fulfills the duty to advise clients about project concerns.
capability Engineer A AV Risk Assessment Active Participation Capability
Clearly articulating unresolved safety concerns within the risk management team constitutes advising the employer that the project may not be successful.
capability Engineer A Regulatory Gap Safety Escalation Software Standards Capability
Advising the employer that a regulatory gap heightens safety obligations is a direct application of the duty to inform clients of potential project failure.
constraint Engineer A AV Informed Employer Decision Enablement Constraint
The duty to advise clients when a project will not be successful requires ensuring the automobile manufacturer has full material safety information to make informed decisions.
constraint Engineer A AV Further Study Before Deployment Constraint
Advising the client when a project will not be successful requires recommending further study before deployment when safety concerns remain unresolved.
constraint Engineer A AV Further Study Recommendation Constraint
The obligation to advise clients of project concerns directly requires Engineer A to recommend further study rather than remain silent about identified safety issues.
constraint Engineer A AV Risk Assessment Active Participation Constraint
Advising the client of project concerns requires full active participation in the risk assessment process to provide complete and accurate counsel.
constraint Engineer A AV Harm Allocation Algorithm Completeness Disclosure Constraint
Advising the client when a project will not be successful requires complete disclosure of the harm-allocation algorithm's limitations to enable informed client decisions.
constraint Engineer A BER 96-4 Business Pressure Technical Separation Constraint
The duty to advise clients honestly about project success requires separating technical safety assessments from financial pressures when counseling the employer.
constraint Engineer A AV Client Interest Third-Party Safety Priority Constraint
Advising the client when a project will not be successful includes informing them when client commercial interests conflict with third-party safety obligations.
constraint Engineer A AV Do No Harm Deployment Constraint
The obligation to advise clients of project concerns supports the constraint against recommending deployment without first addressing do no harm requirements.
Cited Precedent Cases
View Extraction
BER Case 96-4 analogizing

Principle Established:

Engineers have a professional obligation to recommend additional testing or study when public health, safety, and welfare may be at risk, and must make recommendations based solely on technical findings rather than business considerations, so that employers can make informed decisions.

Citation Context:

The Board cited this case to establish that engineers must balance technical safety obligations against business pressures, and that the overriding ethical responsibility is to hold paramount the safety, health, and welfare of the public. It is used as an analogous precedent for Engineer A's obligations in the autonomous vehicle context.

Relevant Excerpts:

From discussion:
"One example of this was BER Case 96-4 , which involved software design testing. In that case, Engineer A was employed by a software company and was involved in the design of specialized software"
From discussion:
"Although the facts in the present case are somewhat different than those in Case 96-4 , the Board of Ethical Review believes that several points discussed in the previous case are pertinent to the case at hand."
From discussion:
"In BER Case 96-4 , Engineer A's ethical concerns in the case were not related directly to the safety of the software, but instead to the availability of a new draft safety testing standard"
Questions & Conclusions
View Extraction
Each question is shown with its corresponding conclusion(s). This reveals the board's reasoning flow.
Rich Analysis Results
View Extraction
Causal-Normative Links 6
Recommend Additional Safety Testing
Fulfills
  • Engineer A AV Further Study Recommendation Before Deployment Obligation
  • Engineer A BER 96-4 Additional Testing Recommendation Obligation
  • New Draft Standard Awareness Additional Testing Recommendation Obligation
  • Autonomous Vehicle Further Study Recommendation Before Deployment Obligation
  • Engineer A AV Further Study Recommendation Before Deployment Obligation
Violates None
Actively Participate in Risk Assessment
Fulfills
  • Engineer A AV Risk Assessment Team Harm Minimization Participation Obligation
  • Engineer A Autonomous Vehicle Risk Assessment Active Participation Obligation
  • Autonomous Vehicle Risk Assessment Active Participation and Concern Expression Obligation
Violates None
Prepare Transparent Technical Report
Fulfills
  • Engineer A BER 96-4 Technical Report Preparation Obligation
  • Autonomous Vehicle Harm Minimization Algorithm Completeness Disclosure Obligation
  • Autonomous Vehicle Moral Framework Public Transparency Disclosure Obligation
  • Engineer A AV Moral Framework Public Transparency Recommendation Obligation
  • Engineer A AV Faithful Agent Informed Decision Enablement Obligation
  • Safety-Critical Software Informed Employer Decision Enablement Obligation
Violates None
Unambiguously Express Safety Concerns
Fulfills
  • Autonomous Vehicle Risk Assessment Active Participation and Concern Expression Obligation
  • Engineer A Autonomous Vehicle Risk Assessment Active Participation Obligation
  • Engineer A AV Risk Assessment Third-Party Safety Consideration Obligation
  • Autonomous Vehicle Third-Party Harm Minimization Safety Consideration Obligation
  • Engineer A Autonomous Vehicle Do No Harm Obligation
  • Engineer A BER 96-4 Public Welfare Paramount Safety-Critical Software Obligation
Violates None
Explore Additional Technical Mitigation Options
Fulfills
  • Engineer A AV Further Study Recommendation Before Deployment Obligation
  • Autonomous Vehicle Further Study Recommendation Before Deployment Obligation
  • Engineer A AV Risk Assessment Team Harm Minimization Participation Obligation
  • Technical Recommendation Business Pressure Non-Subordination Obligation
  • Engineer A BER 96-4 Business Pressure Non-Subordination Obligation
Violates None
Propose Further Study Before Deployment
Fulfills
  • Engineer A AV Further Study Recommendation Before Deployment Obligation
  • Engineer A Autonomous Vehicle Further Study Recommendation Obligation
  • Autonomous Vehicle Further Study Recommendation Before Deployment Obligation
  • Engineer A AV Faithful Agent Informed Decision Enablement Obligation
  • Engineer A Autonomous Vehicle Do No Harm Obligation
  • Autonomous Vehicle Third-Party Harm Minimization Safety Consideration Obligation
  • Engineer A AV Risk Assessment Team Harm Minimization Participation Obligation
  • Engineer A Autonomous Vehicle Risk Assessment Active Participation Obligation
  • Autonomous Vehicle Risk Assessment Active Participation and Concern Expression Obligation
  • Technical Recommendation Business Pressure Non-Subordination Obligation
Violates None
Question Emergence 17

Triggering Events
  • Unavoidable Crash Scenario Identified
  • Algorithmic Ethics Gap Recognized
  • Precedent Case Principles Activated
Triggering Actions
  • Prepare Transparent Technical Report
  • Unambiguously Express Safety Concerns
Competing Warrants
  • Autonomous System Moral Framework Transparency Obligation Engineer A AV Faithful Agent Informed Decision Enablement Obligation
  • Algorithmic Harm Distribution Ethics in Autonomous Systems Completeness and Non-Selectivity in Advisory Opinions Invoked by Engineer A Risk Assessment Team
  • Engineer A AV Moral Framework Public Transparency Recommendation Obligation Autonomous Vehicle Harm Minimization Algorithm Completeness Disclosure Obligation

Triggering Events
  • Autonomous Vehicle AV OS Development Initiated
  • Unavoidable Crash Scenario Identified
  • Algorithmic Ethics Gap Recognized
Triggering Actions
  • Actively Participate in Risk Assessment
  • Unambiguously Express Safety Concerns
Competing Warrants
  • Faithful Agent Obligation Within Ethical Limits Invoked for Engineer A Consultant Role Third-Party Non-Client Welfare Consideration Invoked in Autonomous Vehicle Design

Triggering Events
  • Unavoidable Crash Scenario Identified
  • Algorithmic Ethics Gap Recognized
  • Autonomous Vehicle AV OS Development Initiated
Triggering Actions
  • Explore Additional Technical Mitigation Options
  • Propose Further Study Before Deployment
Competing Warrants
  • Competing Public Goods Balancing Invoked in Passenger vs. Third-Party Safety Trade-Off Public Welfare Paramount Invoked in Autonomous Vehicle Crash Algorithm Design

Triggering Events
  • Algorithmic Ethics Gap Recognized
  • Autonomous Vehicle AV OS Development Initiated
  • Precedent Case Principles Activated
  • Draft Safety Standards Emerge
Triggering Actions
  • Propose Further Study Before Deployment
  • Prepare Transparent Technical Report
  • Recommend Additional Safety Testing
Competing Warrants
  • Regulatory Gap Safety Escalation Obligation Invoked in Software Testing Case Completeness and Non-Selectivity in Advisory Opinions Invoked by Engineer A Risk Assessment Team

Triggering Events
  • Autonomous Vehicle AV OS Development Initiated
  • Algorithmic Ethics Gap Recognized
  • Precedent Case Principles Activated
Triggering Actions
  • Unambiguously Express Safety Concerns
  • Propose Further Study Before Deployment
  • Explore Additional Technical Mitigation Options
Competing Warrants
  • Engineer A AV Risk Assessment Team Harm Minimization Participation Obligation Engineer A AV Regulatory Standards Vacuum Escalation Permissibility Constraint
  • Technical Recommendation Business Pressure Non-Subordination Obligation Engineer A AV Client Interest Third-Party Safety Priority Constraint
  • Autonomous Vehicle Third-Party Harm Minimization Safety Consideration Obligation Engineer A AV Passenger Priority Algorithm Third-Party Fatal Harm Non-Subordination Constraint
  • Faithful Agent Obligation Within Ethical Limits Invoked for Engineer A Consultant Role Do No Harm Obligation Invoked by Engineer A in Autonomous Vehicle Case

Triggering Events
  • Algorithmic Ethics Gap Recognized
  • Unavoidable Crash Scenario Identified
  • Precedent Case Principles Activated
Triggering Actions
  • Prepare Transparent Technical Report
  • Unambiguously Express Safety Concerns
  • Actively Participate in Risk Assessment
Competing Warrants
  • Engineer A AV Faithful Agent Informed Decision Enablement Obligation Informed Decision-Making Enablement Obligation Invoked for Automobile Manufacturer Client
  • Completeness and Non-Selectivity in Advisory Opinions Invoked by Engineer A Risk Assessment Team Engineer A Autonomous Vehicle Risk Assessment Active Participation Obligation
  • Faithful Agent Obligation Within Ethical Limits Invoked for Engineer A Consultant Role Do No Harm Obligation Invoked by Engineer A in Autonomous Vehicle Case

Triggering Events
  • Algorithmic Ethics Gap Recognized
  • Autonomous Vehicle AV OS Development Initiated
  • Precedent Case Principles Activated
Triggering Actions
  • Prepare Transparent Technical Report
  • Unambiguously Express Safety Concerns
Competing Warrants
  • Autonomous System Moral Framework Transparency Obligation Invoked in AV Design Informed Decision-Making Enablement Obligation Invoked for Automobile Manufacturer Client

Triggering Events
  • Unavoidable Crash Scenario Identified
  • Algorithmic Ethics Gap Recognized
  • Autonomous Vehicle AV OS Development Initiated
  • Precedent Case Principles Activated
Triggering Actions
  • Actively Participate in Risk Assessment
  • Unambiguously Express Safety Concerns
  • Explore Additional Technical Mitigation Options
Competing Warrants
  • Do No Harm Obligation Invoked by Engineer A in Autonomous Vehicle Case Faithful Agent Obligation Within Ethical Limits Invoked for Engineer A Consultant Role
  • Algorithmic Harm Distribution Ethics Invoked in Autonomous Vehicle Case Third-Party Non-Client Welfare Consideration Invoked in Autonomous Vehicle Case

Triggering Events
  • Autonomous Vehicle AV OS Development Initiated
  • Unavoidable Crash Scenario Identified
  • Algorithmic Ethics Gap Recognized
Triggering Actions
  • Explore Additional Technical Mitigation Options
  • Propose Further Study Before Deployment
Competing Warrants
  • Autonomous Vehicle Third-Party Harm Minimization Safety Consideration Obligation Engineer A AV Further Study Recommendation Before Deployment Obligation
  • Competing Public Goods Balancing Invoked in Passenger vs. Third-Party Safety Trade-Off Public Welfare Paramount Invoked in Autonomous Vehicle Crash Algorithm Design
  • Algorithmic Harm Distribution Ethics in Autonomous Systems Third-Party Non-Client Welfare Consideration in Autonomous System Design

Triggering Events
  • Autonomous Vehicle AV OS Development Initiated
  • Unavoidable Crash Scenario Identified
  • Algorithmic Ethics Gap Recognized
  • Precedent Case Principles Activated
Triggering Actions
  • Actively Participate in Risk Assessment
  • Explore Additional Technical Mitigation Options
  • Propose Further Study Before Deployment
Competing Warrants
  • Engineer A AV Risk Assessment Team Harm Minimization Participation Obligation Engineer A AV Faithful Agent Informed Decision Enablement Obligation
  • Engineer A Autonomous Vehicle Do No Harm Obligation Autonomous Vehicle Third-Party Harm Minimization Safety Consideration Obligation
  • Technical Recommendation Business Pressure Non-Subordination Obligation Engineer A AV Further Study Recommendation Before Deployment Obligation

Triggering Events
  • Autonomous Vehicle AV OS Development Initiated
  • Algorithmic Ethics Gap Recognized
  • Unavoidable Crash Scenario Identified
Triggering Actions
  • Prepare Transparent Technical Report
  • Propose Further Study Before Deployment
  • Unambiguously Express Safety Concerns
Competing Warrants
  • Autonomous Vehicle Moral Framework Public Transparency Disclosure Obligation Engineer A AV Faithful Agent Informed Decision Enablement Obligation
  • Third-Party Non-Client Welfare Consideration Invoked in Autonomous Vehicle Design Autonomous System Moral Framework Transparency Obligation Invoked in AV Design
  • Engineer A AV Moral Framework Public Transparency Recommendation Obligation Engineer A AV Further Study Recommendation Before Deployment Obligation

Triggering Events
  • Unavoidable Crash Scenario Identified
  • Algorithmic Ethics Gap Recognized
  • Autonomous Vehicle AV OS Development Initiated
Triggering Actions
  • Recommend Additional Safety Testing
  • Unambiguously Express Safety Concerns
  • Propose Further Study Before Deployment
Competing Warrants
  • Engineer A Autonomous Vehicle Do No Harm Obligation Engineer A AV Faithful Agent Informed Decision Enablement Obligation
  • Autonomous Vehicle Third-Party Harm Minimization Safety Consideration Obligation Technical Recommendation Business Pressure Non-Subordination Obligation
  • Engineer A AV Passenger Priority Algorithm Third-Party Fatal Harm Non-Subordination Constraint Graduated Internal Escalation Before External Reporting Invoked in Software Testing Case

Triggering Events
  • Autonomous Vehicle AV OS Development Initiated
  • Algorithmic Ethics Gap Recognized
  • Unavoidable Crash Scenario Identified
Triggering Actions
  • Actively Participate in Risk Assessment
  • Unambiguously Express Safety Concerns
  • Prepare Transparent Technical Report
Competing Warrants
  • Engineer A AV Faithful Agent Informed Decision Enablement Obligation Faithful Agent Obligation Within Ethical Limits Invoked for Engineer A Consultant Role
  • Engineer A Autonomous Vehicle Do No Harm Obligation Autonomous Vehicle Third-Party Harm Minimization Safety Consideration Obligation
  • Engineer A AV Regulatory Standards Vacuum Escalation Permissibility Constraint Engineer A AV Client Interest Third-Party Safety Priority Constraint

Triggering Events
  • Unavoidable Crash Scenario Identified
  • Algorithmic Ethics Gap Recognized
  • Precedent Case Principles Activated
Triggering Actions
  • Unambiguously Express Safety Concerns
  • Actively Participate in Risk Assessment
Competing Warrants
  • Engineer A Autonomous Vehicle Risk Assessment Active Participation Obligation Technical Recommendation Independence from Business Considerations Invoked in Software Testing Case
  • Active Risk Assessment Team Participation Obligation Invoked by Engineer A Engineer A BER 96-4 Business Pressure Non-Subordination Obligation
  • Do No Harm Obligation in Professional Engineering Services Faithful Agent Obligation Within Ethical Limits Invoked for Engineer A Consultant Role

Triggering Events
  • Algorithmic Ethics Gap Recognized
  • Autonomous Vehicle AV OS Development Initiated
  • Precedent Case Principles Activated
Triggering Actions
  • Prepare Transparent Technical Report
Competing Warrants
  • Autonomous Vehicle Moral Framework Public Transparency Disclosure Obligation Engineer A AV Harm Allocation Moral Framework Non-Deception Public Disclosure Constraint
  • Autonomous System Moral Framework Transparency Obligation Invoked in AV Design Engineer A AV Regulatory Standards Vacuum Heightened Disclosure Constraint
  • Completeness and Non-Selectivity in Advisory Opinions Invoked by Engineer A Risk Assessment Team Informed Decision-Making Enablement Obligation Invoked for Automobile Manufacturer Client

Triggering Events
  • Autonomous Vehicle AV OS Development Initiated
  • Algorithmic Ethics Gap Recognized
  • Draft Safety Standards Emerge
  • Precedent Case Principles Activated
Triggering Actions
  • Propose Further Study Before Deployment
  • Prepare Transparent Technical Report
  • Recommend Additional Safety Testing
Competing Warrants
  • Engineer A AV Further Study Recommendation Before Deployment Obligation New Draft Standard Awareness Additional Testing Recommendation Obligation
  • Engineer A AV Regulatory Standards Vacuum Escalation Permissibility Constraint Engineer A BER 96-4 Emerging Standard Technical Report Disclosure Constraint
  • Autonomous Vehicle Further Study Recommendation Before Deployment Obligation Technical Recommendation Business Pressure Non-Subordination Obligation

Triggering Events
  • Unavoidable Crash Scenario Identified
  • Algorithmic Ethics Gap Recognized
  • Autonomous Vehicle AV OS Development Initiated
  • Precedent Case Principles Activated
Triggering Actions
  • Explore Additional Technical Mitigation Options
  • Prepare Transparent Technical Report
  • Unambiguously Express Safety Concerns
  • Propose Further Study Before Deployment
Competing Warrants
  • Autonomous Vehicle Harm Minimization Algorithm Completeness Disclosure Obligation Engineer A AV Moral Framework Public Transparency Recommendation Obligation
  • Autonomous Vehicle Third-Party Harm Minimization Safety Consideration Obligation Engineer A AV Faithful Agent Informed Decision Enablement Obligation
  • Autonomous Vehicle Moral Framework Public Transparency Disclosure Obligation
Resolution Patterns 18

Determinative Principles
  • Public Welfare Paramount as governing metric in aggregate harm conflicts
  • Competing Public Goods Balancing as corrective against naive utilitarian aggregation
  • Equal counting of all lives in harm-minimization calculus
Determinative Facts
  • Passenger safety is a genuine public good, not merely a commercial preference, because passengers are also members of the public whose welfare the Code protects
  • The algorithm that best protects passengers is the same algorithm most likely to cause fatal harm to a greater number of third parties, making the conflict direct and quantifiable
  • The Board's conclusion mandates minimizing harm to the least number of persons, implying an aggregate cross-party calculus rather than categorical passenger exclusion

Determinative Principles
  • Autonomous System Moral Framework Transparency Obligation intensified by regulatory vacuum
  • Regulatory Gap Safety Escalation Obligation requiring the gap itself to be flagged as a safety concern
  • Completeness and Non-Selectivity in Advisory Opinions preventing selective silence about contestable ethical assumptions
Determinative Facts
  • No established national or industry standards govern autonomous vehicle harm-allocation ethics at the time of Engineer A's assessment, creating a regulatory vacuum in which Engineer A's judgment substitutes for an absent standard
  • The harm-minimization recommendation rests on a utilitarian moral framework rather than a settled engineering standard, making the ethical assumptions contestable and therefore requiring disclosure
  • The software testing precedent in BER Case 96-4 established that a regulatory gap triggers an obligation to flag the absence of standards as itself a safety concern and to recommend further study before deployment

Determinative Principles
  • Virtue ethics / professional integrity and moral courage
  • Practical wisdom (phronesis) as a guide to recognizing limits of technical mandate
  • Prohibition on manufacturing false certainty about genuinely contested moral questions
Determinative Facts
  • Engineer A operates within a risk assessment team subject to commercial pressure to prioritize passenger safety
  • The harm-allocation problem is not purely technical and the team's composition may be inadequate to resolve embedded ethical questions
  • Recommending further interdisciplinary study before deployment is itself an expression of professional integrity, not a failure to answer

Determinative Principles
  • Faithful Agent Obligation — complete and accurate disclosure of professionally relevant information, including commercially inconvenient information
  • Public Welfare Paramount Obligation — formal raising, documentation, and consideration of known foreseeable public safety risks
  • Silence as a non-neutral act constituting an affirmative breach of professional duty
Determinative Facts
  • Partial disclosure omitting third-party harm implications would deprive the manufacturer of the ability to make an informed ethical and legal risk decision
  • A harm-allocation algorithm that foreseeably causes fatal harm to third parties in a predictable class of scenarios is not a successful engineering outcome
  • Engineer A's silence would allow a design to proceed toward deployment without safety concerns being formally raised or documented

Determinative Principles
  • Escalation obligation when prospective design input becomes formal objection to existing policy
  • Prohibition on approving engineering documents not in conformity with sound engineering principles
  • Public welfare paramount obligation as a potential trigger for external reporting when internal escalation fails
Determinative Facts
  • The manufacturer had already established a firm passenger-priority policy before Engineer A joined the team, converting Engineer A's role from prospective recommender to formal objector
  • The existing policy creates foreseeable fatal risks to third parties that Engineer A regards as inconsistent with the public welfare paramount obligation
  • Continued participation in design and certification of a system Engineer A has formally identified as posing unreasonable fatal risk to third parties is difficult to reconcile with the Code

Determinative Principles
  • Technical mitigation substantially but not fully dissolves the pre-commitment harm-allocation dilemma
  • Residual disclosure obligation regarding reliability limitations, failure modes, and implicit biases of the dynamic system
  • Transparency and further study obligations persist regardless of whether the algorithm operates in real time or through pre-commitment
Determinative Facts
  • A dynamic real-time evaluation system eliminates the most ethically troubling feature of pre-committed logic — categorical pre-assignment of fatal risk to identifiable classes of persons
  • The dynamic system retains sensor failure modes, edge cases where real-time evaluation is impossible, and potential implicit harm-allocation biases in input variable weighting
  • The novelty of the technology means real-world performance across the full range of crash scenarios cannot be validated through design analysis alone

Determinative Principles
  • Public Welfare Paramount obligation is explicitly primary in the NSPE Code hierarchy and is not co-equal with the faithful agent duty
  • Faithful Agent Obligation operates only within the ethical limits defined by the paramount obligation — it does not authorize recommendations that foreseeably cause fatal third-party harm
  • Competing Public Goods Balancing acknowledges passenger safety as a legitimate interest but subordinates it to the paramount obligation when the passenger-protective algorithm is the same algorithm most likely to cause fatal third-party harm
Determinative Facts
  • The manufacturer's commercial interest in a passenger-priority algorithm directly conflicts with the safety of pedestrians, cyclists, and motorcycle riders, making the conflict between Q6 obligations concrete rather than hypothetical
  • The NSPE Code establishes an explicit hierarchy in which public welfare is paramount, meaning the board did not need to treat the faithful agent duty and the third-party welfare consideration as equal weights requiring balancing
  • Engineer A can serve the manufacturer's legitimate interests constructively — by identifying technical solutions that minimize passenger harm within the harm-minimization framework — without suppressing or softening the safety recommendation

Determinative Principles
  • Public Welfare Paramount — the obligation to hold paramount the safety, health, and welfare of the public overrides competing commercial or passenger-protective interests
  • Aggregate Harm Minimization — when lives cannot all be protected, the ethical directive is to minimize the total number of persons harmed
  • Third-Party Non-Client Welfare Consideration — pedestrians, cyclists, and motorcyclists who are not parties to the client relationship are nonetheless owed professional protection
Determinative Facts
  • The autonomous vehicle's harm-allocation algorithm must make a pre-committed decision about whose safety to prioritize in unavoidable crash scenarios
  • Third parties such as pedestrians, cyclists, and motorcyclists are foreseeably at risk from a passenger-prioritizing algorithm
  • Engineer A is serving as a professional advisor on a risk assessment team with direct influence over the algorithm's design logic

Determinative Principles
  • Completeness and Non-Selectivity in Advisory Opinions — Engineer A must not present a recommendation grounded in a specific moral philosophy as though it were a technically mandated or universally accepted engineering norm
  • Informed Decision-Making Enablement — the manufacturer cannot give genuine informed consent to an embedded ethical framework it does not know it is adopting
  • Regulatory Gap Transparency — the absence of applicable national or industry standards heightens rather than relieves the professional advisor's obligation to disclose the normative basis of any recommendation
Determinative Facts
  • No applicable national or industry standards governing autonomous vehicle harm-allocation decision logic currently exist
  • The harm-minimization recommendation is grounded in a utilitarian ethical framework, not in any established regulatory or technical standard
  • Engineer A occupies an advisory role in which the manufacturer will rely on Engineer A's professional judgment to make a deployment decision affecting the public

Determinative Principles
  • Public Welfare Paramount Duty Applies Equally to Consultants — the NSPE Code's paramount obligation to public safety is not diminished by the absence of a direct employment relationship
  • Graduated Internal Escalation Before External Action — Engineer A must pursue documented internal escalation through the organizational hierarchy before considering withdrawal or external reporting
  • Refusal to Certify as a Professional Threshold — if internal escalation fails and Engineer A cannot professionally certify the system as consistent with public welfare obligations, continued participation may constitute implicit endorsement of a harmful design
Determinative Facts
  • The automobile manufacturer may override Engineer A's harm-minimization recommendation and program the vehicle to prioritize passenger safety above third-party welfare
  • Engineer A is engaged as a consultant rather than a direct employee, raising the question of whether the consultant relationship reduces the scope of professional ethical duties
  • A passenger-prioritizing algorithm foreseeably causes fatal injury to third parties who are not parties to the client relationship

Determinative Principles
  • Technical Mitigation Before Ethical Dilemma Acceptance — Engineer A has a professional competence obligation to investigate whether the binary dilemma is technically irreducible before recommending a pre-committed harm-allocation rule
  • Analogical Reasoning from BER Case 96-4 — the obligation to recommend further study before deployment of safety-critical systems applies equally when the ethical dilemma itself may be dissolved by superior technical alternatives
  • Completeness of Professional Recommendation — recommending harm minimization without first exhausting technically feasible alternatives that could reduce the need for any pre-committed allocation is itself an incomplete discharge of Engineer A's public welfare and professional competence obligations
Determinative Facts
  • Sensor-based dynamic crash evaluation systems capable of real-time scenario assessment may represent a technically superior alternative to pre-committed algorithmic harm-allocation logic
  • The binary ethical dilemma between passenger safety and third-party harm minimization may be substantially reduced or dissolved if dynamic assessment is technically feasible
  • No finding has been made that dynamic mitigation alternatives are technically infeasible, meaning the dilemma has not yet been established as irreducible

Determinative Principles
  • Completeness and Non-Selectivity in Advisory Opinions — Engineer A must affirmatively disclose that the harm-minimization recommendation reflects a specific moral philosophy and that alternative frameworks exist and yield different algorithmic outcomes
  • Informed Consent to Embedded Ethical Framework — the manufacturer cannot make a genuinely informed deployment decision without knowing that the selection among ethical frameworks is not a purely technical determination
  • Deontological Challenge to Utilitarian Harm Allocation — a deontological framework would prohibit the vehicle from actively redirecting harm toward any third party regardless of aggregate outcome, representing a defensible alternative that Engineer A must surface rather than suppress
Determinative Facts
  • The Board's harm-minimization conclusion implicitly adopts a utilitarian aggregate harm-minimization calculus without acknowledging it as one among several defensible moral philosophies
  • Alternative ethical frameworks — particularly deontological approaches — yield materially different algorithmic outcomes and are not merely academic alternatives but practically consequential design choices
  • Full public transparency about the algorithm's moral logic could expose the manufacturer to legal liability or competitive disadvantage that the client has not knowingly accepted

Determinative Principles
  • Public Welfare Paramount principle — protection from material deception about safety-affecting products
  • Autonomous System Moral Framework Transparency Obligation — users and third parties have a legitimate interest in knowing pre-committed decision logic governing their fate
  • Regulatory Gap Safety Escalation — absence of external regulatory mandate heightens rather than relieves professional disclosure duty
Determinative Facts
  • No applicable regulatory or industry standards govern autonomous vehicle harm-allocation decision logic at the time of Engineer A's assessment
  • The harm-allocation algorithm pre-commits to outcomes on behalf of users who cannot intervene in real time, removing informed consent from the moment of consequence
  • BER Case 96-4 established analogous precedent that a regulatory vacuum increases rather than diminishes the engineer's independent disclosure obligations

Determinative Principles
  • Graduated Internal Escalation Before External Reporting — Engineer A must formally document disagreement in writing before external action is warranted
  • Code prohibition on approving engineering documents not conforming to sound safety principles — Engineer A must decline to certify a passenger-priority system if it crosses the threshold of unjustifiable third-party risk
  • Public Welfare Paramount obligation is not discharged by internal voicing of concern alone when that concern is overridden and a harmful design proceeds
Determinative Facts
  • The manufacturer has overridden Engineer A's harm-minimization recommendation and elected a passenger-priority algorithm that foreseeably creates fatal risk to identifiable third-party classes
  • Engineer A's initial recommendation has already been made, meaning residual obligations — not initial advisory duties — are now operative
  • The passenger-priority algorithm creates foreseeable fatal risk to pedestrians, cyclists, and motorcycle riders as identifiable third-party classes, not merely speculative harm

Determinative Principles
  • Public Welfare Paramount obligation applies with equal force to consultants and employees — the employment relationship does not define the scope of the safety duty
  • Professional independence of the consultant relationship strengthens rather than weakens the obligation to provide honest, complete, and unvarnished safety assessments
  • Consultant status compresses the internal escalation sequence because fewer organizational tiers exist through which concerns must be pressed before the duty is satisfied
Determinative Facts
  • Engineer A is engaged as a consultant rather than a direct employee, meaning the client specifically contracted for Engineer A's independent professional judgment
  • A consultant has fewer internal escalation tiers available than an embedded employee, meaning formal documentation and direct communication to responsible decision-makers more rapidly satisfies the escalation component
  • Engineer A's silence or partial assessment (Q14) would have deprived the manufacturer of the complete information needed for an ethically informed deployment decision, constituting a faithful agent violation regardless of employment status

Determinative Principles
  • Categorical imperative — Engineer A must not recommend a design that treats any class of persons as mere instruments for the benefit of another class, regardless of aggregate welfare outcomes
  • Deontological constraint is stronger than and not fully captured by the utilitarian harm-minimization conclusion — it prohibits systematic pre-commitment to instrumental use of any person's life
  • The framing of the harm-allocation problem as a binary choice between passenger priority and aggregate minimization may itself embed morally problematic assumptions that warrant further study before deployment
Determinative Facts
  • A passenger-priority algorithm systematically redirects lethal force toward pedestrians, treating them as means to passenger safety ends in a manner the categorical imperative prohibits regardless of aggregate welfare outcomes
  • A pure harm-minimization algorithm that sacrifices a single passenger to save multiple pedestrians may itself treat the passenger as a means to aggregate welfare ends, meaning neither binary option fully satisfies deontological constraints
  • Technical alternatives — such as crash avoidance design rather than crash outcome optimization — may exist that avoid pre-committing to the instrumental use of any person's life, and Engineer A has an obligation to flag this possibility to the manufacturer

Determinative Principles
  • Regulatory gap as itself a safety-relevant fact requiring disclosure
  • External standards as an epistemic basis that changes the character but not the strength of the recommendation obligation
  • Provisional and explicitly flagged guidance required in the absence of industry consensus
Determinative Facts
  • No applicable national or industry standards governing autonomous vehicle harm-allocation decision logic existed at the time of Engineer A's assessment
  • The absence of applicable standards means no external body has validated any harm-allocation approach as meeting a minimum public safety standard
  • The BER Case 96-4 analogy establishes that a regulatory gap is itself a safety-relevant fact the manufacturer must be informed of before deployment

Determinative Principles
  • Public Welfare Paramount as lexical side-constraint on faithful agent role
  • Faithful Agent Obligation Within Ethical Limits
  • Third-Party Non-Client Welfare Consideration
Determinative Facts
  • The harm-allocation algorithm is pre-committed, meaning risk transfer to third parties is systematic and foreseeable rather than incidental
  • Third-party pedestrians, cyclists, and motorcyclists are non-consenting bearers of the fatal risk created by the algorithm
  • The client-versus-third-party conflict is genuinely zero-sum: protecting passengers via this algorithm necessarily increases lethal risk to others
Loading entity-grounded arguments...
Decision Points
View Extraction
Legend: PRO CON | N% = Validation Score
DP1 Engineer A is a licensed professional engineer serving as a consultant on an automobile manufacturer's risk assessment team evaluating a driverless/autonomous vehicle operating system. The team has identified unavoidable crash scenarios in which the vehicle's pre-committed harm-allocation algorithm must choose between protecting passengers and protecting third parties such as pedestrians, cyclists, and motorcycle riders. Engineer A has unresolved ethical and safety concerns about the algorithm's harm-distribution logic and must decide how to discharge his professional obligations as a team member.

Should Engineer A actively participate in the risk assessment team and formally express safety concerns about the harm-allocation algorithm — recommending further study before deployment — or should he limit his involvement to completing the technical evaluation without escalating those concerns?

Options:
  1. Formally Document Concerns, Recommend Further Study
  2. Complete Evaluation Without Escalating Concerns
  3. Flag Concerns Verbally, Defer Written Escalation
85% aligned
DP2 Engineer A has been asked to recommend a crash-avoidance algorithm's harm-distribution logic for an autonomous vehicle operating system. The board's harm-minimization conclusion implicitly adopts a utilitarian ethical framework — aggregate harm reduction across all affected parties — rather than a passenger-priority approach. No applicable national or industry standards govern autonomous vehicle harm-allocation decision logic. Engineer A must decide how to characterize the recommendation's philosophical basis in the risk assessment report and whether to recommend that the manufacturer publicly disclose the embedded ethical framework to prospective consumers before sale.

Should Engineer A explicitly disclose in the risk assessment report that the harm-minimization recommendation is grounded in a utilitarian ethical framework and recommend pre-sale public disclosure to consumers, or should Engineer A present the recommendation without labeling its philosophical basis?

Options:
  1. Disclose Ethical Framework Publicly in Report
  2. Present Both Frameworks Without Endorsing Either
  3. Disclose Framework Internally, Recommend Ethics Review
82% aligned
DP3 After receiving Engineer A's harm-minimization recommendation, the automobile manufacturer overrides it and elects to program the autonomous vehicle to prioritize passenger safety above third-party welfare. The passenger-priority algorithm foreseeably creates fatal risk for pedestrians, cyclists, and other third parties. Engineer A must decide how to respond to the override — including whether to formally escalate the safety disagreement, decline to certify the system, or consider external reporting if internal escalation fails.

Should Engineer A formally notify the manufacturer's responsible decision-makers of the foreseeable fatal risk and — if unresolved — decline to certify the passenger-priority system, or should Engineer A document the disagreement without further escalation, or recommend an independent ethics review as an alternative to certification refusal?

Options:
  1. Formally Notify Manufacturer of Fatal Risk
  2. Document Disagreement, Treat Escalation as Complete
  3. Recommend Independent Ethics Review Before Deployment
80% aligned
DP4 Engineer A is a consultant on an automobile manufacturer's risk assessment team evaluating an autonomous vehicle operating system. The team has identified an unavoidable crash scenario in which the vehicle's pre-committed harm-allocation logic must choose between protecting passengers and protecting third parties such as pedestrians, cyclists, and motorcycle riders. The manufacturer faces commercial pressure to prioritize passenger safety, but Engineer A believes the algorithm should instead minimize harm to the least number of persons regardless of their role in the vehicle.

Should Engineer A formally advocate within the risk assessment team that the harm-allocation algorithm minimize harm to the least number of persons — even under commercial pressure to prioritize passenger safety — or should Engineer A defer to the manufacturer's preferred passenger-priority framework?

Options:
  1. Actively Advocate Harm-Minimization in Writing
  2. Present Options and Defer to Team
  3. Accept Passenger-Priority as Legitimate Policy
88% aligned
DP5 Engineer A has identified an algorithmic ethics gap: no applicable national or industry standards govern autonomous vehicle harm-allocation decision logic. The harm-minimization recommendation Engineer A is prepared to make is grounded in a utilitarian aggregate-harm calculus — a specific moral philosophy — rather than a technically mandated or universally accepted engineering norm. Engineer A must decide whether to disclose this philosophical basis to the manufacturer and, if so, whether to further recommend that the manufacturer publicly disclose the embedded ethical framework to prospective consumers before sale.

Should Engineer A fully disclose to the automobile manufacturer that the harm-minimization recommendation reflects a utilitarian moral philosophy and recommend pre-sale consumer disclosure, partially disclose only to the manufacturer without advocating for consumer transparency, or present the recommendation as professional judgment without labeling its philosophical basis?

Options:
  1. Disclose Utilitarian Basis to Manufacturer Fully
  2. Disclose Internally, Limit Consumer Transparency
  3. Frame as Professional Judgment, Omit Label
83% aligned
DP6 Engineer A has delivered a harm-minimization recommendation to the automobile manufacturer. The manufacturer has overridden that recommendation and elected to program the vehicle to prioritize passenger safety above third-party welfare, creating foreseeable fatal risk to pedestrians and other third parties. Engineer A is a consultant rather than a direct employee. Engineer A must decide whether to formally document the disagreement and decline to certify the passenger-priority system, continue participating while documenting the concern, or withdraw from the engagement — and whether consultant status narrows any of these obligations.

Should Engineer A formally document the safety disagreement and decline to certify the passenger-priority system unless the public safety conflict is resolved, continue technical participation while documenting the concern, or withdraw from the engagement without formal certification refusal?

Options:
  1. Decline to Certify Passenger-Priority System
  2. Document Concern, Continue Technical Participation
  3. Withdraw Silently Without Formal Documentation
80% aligned
Case Narrative

Phase 4 narrative construction results for Case 165

5
Characters
23
Events
9
Conflicts
10
Fluents
Opening Context

You are Engineer A, a specialized software engineer on an Autonomous Vehicle Risk Assessment Team, where your expertise in safety-critical systems has earned you a seat at a table where the stakes extend far beyond code and compliance. Your team is navigating a precarious gap between emerging safety standards and their formal adoption — a space where technical decisions carry profound ethical weight and where the line between "sufficiently tested" and "safe enough" is anything but clear. You have been asked to deliver a harm allocation recommendation that will determine whether costly additional testing is warranted, placing you at the intersection of engineering judgment, organizational pressure, and public safety responsibility.

From the perspective of Engineer A Autonomous Vehicle Risk Assessment Team Engineer
Characters (5)
Engineer A Autonomous Vehicle Risk Assessment Team Engineer Protagonist

A professional engineer who designed and tested specialized software for public-safety-critical facilities and was placed in the ethically precarious position of recommending whether costly additional testing was necessary to meet emerging safety standards.

Motivations:
  • To provide an honest, technically grounded recommendation that upholds public safety and professional integrity, even when doing so conflicts with the financial interests of the employing software company and its clients.
  • To bring a commercially viable and legally defensible autonomous vehicle to market while managing reputational, regulatory, and liability risks associated with algorithmic decisions that directly determine human harm outcomes.
  • To fulfill paramount public safety obligations by ensuring that algorithmic crash outcome logic is rigorously evaluated, transparently documented, and does not unjustly prioritize passenger safety over vulnerable third-party road users.
Automobile Manufacturer Autonomous Vehicle Developer Stakeholder

The automobile manufacturer retains Engineer A as a consultant and has assembled an engineering risk assessment team to evaluate scenarios for a driverless/autonomous vehicle operating system under development, including crash outcome decision logic with direct public safety implications for third parties.

Engineer A Safety-Critical Software Design Engineer (Case 96-4) Protagonist

Designed specialized software for public-safety-critical facilities, conducted extensive testing, became aware of new draft standards the software might not meet, and was asked by the company to recommend whether additional costly testing was required.

Software Company Employer Stakeholder

A software development firm that employs Engineer A to produce safety-critical systems and faces competing pressures between client satisfaction and cost containment on one side, and genuine software safety assurance on the other.

Motivations:
  • To protect the company's financial position and client relationships while avoiding the legal, ethical, and reputational consequences of deploying software that fails to meet evolving public-safety standards.
Automobile Manufacturer Autonomous Vehicle Developer Client (Present Case) Stakeholder

The automobile manufacturer in the present case that employs or retains Engineer A as part of an engineering risk management team to evaluate the autonomous vehicle operating system, bearing authority over deployment decisions and subject to Engineer A's paramount public safety obligations.

Ethical Tensions (9)
Tension between Engineer A AV Risk Assessment Team Harm Minimization Participation Obligation / Autonomous Vehicle Further Study Recommendation Before Deployment Obligation and Engineer A AV Client Interest Third-Party Safety Priority Constraint LLM
Engineer A AV Risk Assessment Team Harm Minimization Participation Obligation Engineer A AV Client Interest Third-Party Safety Priority Constraint
Obligation vs Constraint
Affects: Engineer A Autonomous Vehicle Risk Assessment Team Engineer
Moral Intensity (Jones 1991):
Magnitude: high Probability: high near-term direct diffuse
Tension between Autonomous Vehicle Harm Minimization Algorithm Completeness Disclosure Obligation / Autonomous Vehicle Moral Framework Public Transparency Disclosure Obligation and Engineer A AV Regulatory Standards Vacuum Escalation Permissibility Constraint
Autonomous Vehicle Harm Minimization Algorithm Completeness Disclosure Obligation Engineer A AV Regulatory Standards Vacuum Escalation Permissibility Constraint
Obligation vs Constraint
Affects: Engineer A Autonomous Vehicle Risk Assessment Team Engineer
Tension between Engineer A AV Faithful Agent Informed Decision Enablement Obligation / Technical Recommendation Business Pressure Non-Subordination Obligation and Engineer A AV Passenger Priority Algorithm Third-Party Fatal Harm Non-Subordination Constraint
Engineer A AV Faithful Agent Informed Decision Enablement Obligation Engineer A AV Passenger Priority Algorithm Third-Party Fatal Harm Non-Subordination Constraint
Obligation vs Constraint
Affects: Engineer A Autonomous Vehicle Risk Assessment Team Engineer
Tension between Engineer A Autonomous Vehicle Do No Harm Obligation and Risk Assessment Active Participation Obligation and Engineer A AV Client Interest Third-Party Safety Priority Constraint LLM
Engineer A Autonomous Vehicle Do No Harm Obligation Engineer A AV Client Interest Third-Party Safety Priority Constraint
Obligation vs Constraint
Affects: Engineer
Moral Intensity (Jones 1991):
Magnitude: high Probability: high near-term direct diffuse
Tension between Autonomous Vehicle Moral Framework Public Transparency Recommendation Obligation and Completeness and Non-Selectivity in Advisory Opinions and Engineer A AV Harm Allocation Moral Framework Non-Deception Public Disclosure Constraint
Engineer A AV Moral Framework Public Transparency Recommendation Obligation Engineer A AV Harm Allocation Moral Framework Non-Deception Public Disclosure Constraint
Obligation vs Constraint
Affects: Engineer A Autonomous Vehicle Risk Assessment Team Engineer
Tension between Engineer A AV Risk Assessment Team Harm Minimization Participation Obligation and Graduated Internal Escalation Before External Reporting and Engineer A AV Passenger Priority Algorithm Third-Party Fatal Harm Non-Subordination Constraint
Engineer A AV Risk Assessment Team Harm Minimization Participation Obligation Engineer A AV Passenger Priority Algorithm Third-Party Fatal Harm Non-Subordination Constraint
Obligation vs Constraint
Affects: Engineer A Autonomous Vehicle Risk Assessment Team Engineer
Engineer A is obligated to recommend further study before deployment of the autonomous vehicle system, yet the client (automobile manufacturer) has strong commercial interests in proceeding to market. The constraint demands that third-party safety must take priority over client interests, but acting on this constraint by insisting on further study directly conflicts with the client's deployment timeline and business objectives. Fulfilling the obligation faithfully may require Engineer A to resist client pressure in ways that jeopardize the professional relationship, while yielding to client interest violates the safety-priority constraint. This creates a genuine dilemma between professional loyalty to the client as faithful agent and paramount duty to public safety. LLM
Autonomous Vehicle Further Study Recommendation Before Deployment Obligation Engineer A AV Client Interest Third-Party Safety Priority Constraint
Obligation vs Constraint
Affects: Engineer A Autonomous Vehicle Risk Assessment Team Engineer Automobile Manufacturer Autonomous Vehicle Developer Client Automobile Manufacturer Autonomous Vehicle Developer
Moral Intensity (Jones 1991):
Magnitude: high Probability: high near-term direct diffuse
Engineer A is obligated to recommend that the moral framework embedded in the AV harm-minimization algorithm be disclosed publicly so that consumers and society can make informed decisions. However, the algorithmic pre-commitment ethical constraint recognizes that encoding a fixed harm-allocation decision in advance—and then disclosing it—raises profound ethical problems: public disclosure of a pre-committed framework (e.g., passenger-over-pedestrian priority) may itself be ethically impermissible if that framework encodes morally objectionable trade-offs. Fulfilling the transparency obligation by disclosing the framework validates and entrenches a potentially unjust pre-commitment, while suppressing disclosure violates the transparency obligation. The engineer cannot simultaneously satisfy full transparency and avoid legitimizing an ethically contested algorithmic moral stance. LLM
Autonomous Vehicle Moral Framework Public Transparency Disclosure Obligation Autonomous Vehicle Harm Allocation Algorithmic Pre-Commitment Ethical Constraint
Obligation vs Constraint
Affects: Engineer A Autonomous Vehicle Risk Assessment Team Engineer Automobile Manufacturer Autonomous Vehicle Developer Automobile Manufacturer Autonomous Vehicle Developer Client
Moral Intensity (Jones 1991):
Magnitude: high Probability: medium near-term indirect diffuse
Engineer A has a dual obligation: to refuse subordination of technical safety recommendations to business pressure, and simultaneously to act as a faithful agent enabling the employer/client to make informed decisions. These obligations pull in opposing directions when the client's informed decision—made with full knowledge of Engineer A's safety concerns—is nonetheless to proceed with deployment. If the client is fully informed yet still chooses deployment, the faithful-agent obligation is technically satisfied, but the non-subordination obligation may require Engineer A to escalate or refuse participation, going beyond mere disclosure. Conversely, limiting action to enabling informed decisions without further resistance could be construed as tacit subordination of safety judgment to business outcomes. The tension is between respecting client autonomy after disclosure and maintaining independent professional integrity. LLM
Technical Recommendation Business Pressure Non-Subordination Obligation Engineer A AV Faithful Agent Informed Decision Enablement Obligation
Obligation vs Obligation
Affects: Engineer A Autonomous Vehicle Risk Assessment Team Engineer Engineer A Safety-Critical Software Design Engineer (Case 96-4) Automobile Manufacturer Autonomous Vehicle Developer Client Software Company Employer
Moral Intensity (Jones 1991):
Magnitude: high Probability: high immediate direct concentrated
States (10)
Autonomous System Harm Allocation Design State Engineer A Ethical Dilemma - Harm Allocation Recommendation Emerging Standard Pre-Adoption Safety Gap State Present Case Client-Interest vs Third-Party Safety Algorithmic Pre-Commitment Regulatory Standards Vacuum for Autonomous Vehicle Ethics State Client-Interest vs. Third-Party Safety Algorithmic Pre-Commitment State Autonomous Vehicle Harm Allocation Design Assignment Autonomous Vehicle Ethics Regulatory Standards Vacuum Passenger Safety vs. Third-Party Harm Minimization Algorithm Conflict Public Safety at Risk - Autonomous Vehicle Third-Party Harm
Event Timeline (23)
# Event Type
1 An engineer faces a complex ethical dilemma involving the design of an autonomous system, where decisions must be made about how potential harms and safety responsibilities are allocated among stakeholders. This foundational situation establishes the core tension between technical capability, public safety, and professional obligation. state
2 The engineer formally recommends that the autonomous system undergo additional rounds of safety testing before any further development or deployment decisions are made. This recommendation reflects the engineer's professional duty to ensure that potential failure modes are thoroughly identified and addressed before the system can pose risks to the public. action
3 The engineer prepares a comprehensive and candid technical report that openly documents the system's known limitations, uncertainties, and safety-related findings. By prioritizing transparency over convenience, this report ensures that all relevant parties have accurate information needed to make informed decisions about the system's future. action
4 The engineer takes an active and substantive role in the formal risk assessment process, contributing technical expertise to evaluate the likelihood and severity of potential system failures. This engagement demonstrates the engineer's commitment to ensuring that risk evaluations are grounded in rigorous analysis rather than assumptions or commercial pressures. action
5 The engineer clearly and directly communicates identified safety concerns to supervisors, clients, or other decision-makers, leaving no ambiguity about the nature or seriousness of the risks involved. This decisive action upholds the engineer's ethical obligation to prioritize public safety even when doing so may create professional friction or delay project timelines. action
6 The engineer proactively investigates and proposes additional technical measures that could reduce or eliminate the identified safety risks within the autonomous system. This constructive approach demonstrates that raising safety concerns is paired with a genuine effort to find workable engineering solutions rather than simply halting progress. action
7 The engineer formally advocates for delaying deployment of the autonomous system until further research and study can adequately address the unresolved safety questions. This recommendation prioritizes long-term public welfare over short-term project milestones, reflecting the core principle that engineers must not approve systems whose safety has not been sufficiently validated. action
8 A critical discovery is made that specific software components within the autonomous system directly govern safety-critical functions, meaning that any errors or failures in this code could result in serious harm. This identification significantly escalates the ethical stakes of the case, as it establishes that the system's risks are not merely theoretical but are tied to concrete, high-consequence operational scenarios. automatic
9 Draft Safety Standards Emerge automatic
10 Financial Pressure on Testing automatic
11 Autonomous Vehicle AV OS Development Initiated automatic
12 Unavoidable Crash Scenario Identified automatic
13 Precedent Case Principles Activated automatic
14 Algorithmic Ethics Gap Recognized automatic
15 Tension between Engineer A AV Risk Assessment Team Harm Minimization Participation Obligation / Autonomous Vehicle Further Study Recommendation Before Deployment Obligation and Engineer A AV Client Interest Third-Party Safety Priority Constraint automatic
16 Tension between Autonomous Vehicle Harm Minimization Algorithm Completeness Disclosure Obligation / Autonomous Vehicle Moral Framework Public Transparency Disclosure Obligation and Engineer A AV Regulatory Standards Vacuum Escalation Permissibility Constraint automatic
17 How should Engineer A discharge his obligations as a member of the automobile manufacturer's risk assessment team when the crash-avoidance algorithm's harm-distribution logic raises unresolved ethical and safety questions — specifically, whether to actively express concerns and recommend further study before deployment, or to defer to the team's commercial orientation and provide a narrower assessment? decision
18 Given that no applicable national or industry standards govern autonomous vehicle harm-allocation decision logic, must Engineer A affirmatively disclose to the automobile manufacturer that the harm-minimization recommendation is grounded in a utilitarian ethical framework rather than a technically mandated norm — and must Engineer A further recommend that the manufacturer publicly disclose the algorithm's embedded moral framework to prospective consumers before deployment? decision
19 If the automobile manufacturer overrides Engineer A's harm-minimization recommendation and proceeds with a passenger-priority algorithm that foreseeably creates fatal risk for pedestrians, cyclists, and motorcycle riders, what actions must Engineer A take — and does Engineer A's consultant status affect the scope or sequence of those obligations? decision
20 Should Engineer A recommend that the autonomous vehicle's operating system minimize harm to the least number of persons, and actively express that concern within the risk assessment team even under commercial pressure to prioritize passenger safety? decision
21 Must Engineer A affirmatively disclose to the automobile manufacturer that the harm-minimization recommendation is grounded in a utilitarian ethical framework rather than an established regulatory or industry standard, and must Engineer A further recommend that the manufacturer publicly disclose the vehicle's embedded ethical decision logic to consumers before deployment? decision
22 If the automobile manufacturer overrides Engineer A's harm-minimization recommendation and programs the vehicle to prioritize passenger safety above third-party welfare, what actions must Engineer A take — and does Engineer A's consultant status alter the scope or sequence of those obligations? decision
23 That being said, to address the specific question posed in the case, Engineer A has an obligation to state that the prime ethical obligation of the vehicle operation is to minimize harm to affect the outcome
Decision Moments (6)
1. How should Engineer A discharge his obligations as a member of the automobile manufacturer's risk assessment team when the crash-avoidance algorithm's harm-distribution logic raises unresolved ethical and safety questions — specifically, whether to actively express concerns and recommend further study before deployment, or to defer to the team's commercial orientation and provide a narrower assessment?
  • Actively participate in all risk assessment team deliberations, formally document and unambiguously express concerns about the harm-allocation algorithm's third-party safety implications in writing, recommend that the manufacturer commission further interdisciplinary study — including ethical framework analysis and technical mitigation investigation — before deploying the operating system Actual outcome
  • Participate in the risk assessment team's technical evaluation, raise third-party harm concerns verbally during team deliberations, and provide a written recommendation that identifies the harm-minimization approach as preferable — without separately recommending that deployment be delayed for further study, on the ground that the team's collective judgment and the manufacturer's business timeline should govern the deployment decision once the technical recommendation has been delivered
  • Participate in the risk assessment team's evaluation, recommend harm minimization as the preferred algorithm design, and separately recommend that the manufacturer explore technical mitigation options — such as dynamic real-time crash evaluation systems — as a means of reducing the need for pre-committed harm-allocation logic, framing further study as a technical improvement opportunity rather than a deployment prerequisite
2. Given that no applicable national or industry standards govern autonomous vehicle harm-allocation decision logic, must Engineer A affirmatively disclose to the automobile manufacturer that the harm-minimization recommendation is grounded in a utilitarian ethical framework rather than a technically mandated norm — and must Engineer A further recommend that the manufacturer publicly disclose the algorithm's embedded moral framework to prospective consumers before deployment?
  • Explicitly identify in the written risk assessment report that the harm-minimization recommendation is grounded in a utilitarian ethical framework, present the deontological alternative framework and its different algorithmic implications with equal completeness, and include a specific advisory that the manufacturer implement pre-sale public disclosure of the vehicle's harm-allocation decision logic before deployment Actual outcome
  • Present both the passenger-priority and harm-minimization frameworks objectively in the risk assessment report — including their respective advantages and disadvantages — without characterizing either as utilitarian or deontological, and recommend that the manufacturer consult legal counsel and ethics advisors regarding consumer disclosure obligations, treating the philosophical labeling and public disclosure questions as outside the scope of the engineering risk assessment mandate
  • Identify the philosophical basis of the harm-minimization recommendation in the internal risk assessment report delivered to the manufacturer, recommend that the manufacturer seek interdisciplinary ethics review before finalizing the algorithm design, but decline to recommend specific consumer-facing public disclosure on the ground that disclosure strategy is a legal and business decision within the manufacturer's exclusive authority as client
3. If the automobile manufacturer overrides Engineer A's harm-minimization recommendation and proceeds with a passenger-priority algorithm that foreseeably creates fatal risk for pedestrians, cyclists, and motorcycle riders, what actions must Engineer A take — and does Engineer A's consultant status affect the scope or sequence of those obligations?
  • Formally document the safety disagreement in writing addressed to the manufacturer's responsible decision-makers, clearly stating that the passenger-priority algorithm creates foreseeable fatal risk to third parties inconsistent with the public welfare paramount obligation; assess whether the system crosses the certification threshold under Code II.1.b and decline to certify if it does; and evaluate whether the severity and foreseeability of third-party harm triggers external reporting obligations if internal escalation fails Actual outcome
  • Formally document the safety disagreement in writing, deliver it to the manufacturer's project lead, and — upon being overruled — treat the internal escalation obligation as discharged given the compressed escalation sequence available in a consultant relationship; continue participating in the project in an advisory capacity without certifying the system, on the ground that declining to certify without an applicable regulatory standard to anchor the refusal would exceed the scope of the consultant's professional mandate
  • Document the safety disagreement in the final risk assessment report, recommend that the manufacturer obtain an independent ethics and safety review of the passenger-priority algorithm before deployment, and withdraw from the consulting engagement if the manufacturer proceeds without that review — treating withdrawal as the appropriate professional response that preserves Engineer A's integrity without triggering external reporting obligations that the NSPE Code reserves for more severe and imminent public safety threats
4. Should Engineer A recommend that the autonomous vehicle's operating system minimize harm to the least number of persons, and actively express that concern within the risk assessment team even under commercial pressure to prioritize passenger safety?
  • Formally recommend that the harm-allocation algorithm minimize harm to the least number of persons, actively express this position within the risk assessment team, document the recommendation in writing, and propose further interdisciplinary study and exploration of dynamic real-time mitigation alternatives before deployment Actual outcome
  • Present the harm-minimization approach as one among several technically defensible design options, defer to the risk assessment team's collective judgment on which framework to adopt, and limit Engineer A's formal output to a balanced technical summary of competing approaches without a personal recommendation
  • Recommend harm minimization internally within the risk assessment team but accept the manufacturer's passenger-priority preference as a legitimate design policy choice within the manufacturer's authority, confining Engineer A's role to optimizing the passenger-priority algorithm's technical implementation rather than contesting the underlying policy
5. Must Engineer A affirmatively disclose to the automobile manufacturer that the harm-minimization recommendation is grounded in a utilitarian ethical framework rather than an established regulatory or industry standard, and must Engineer A further recommend that the manufacturer publicly disclose the vehicle's embedded ethical decision logic to consumers before deployment?
  • Explicitly disclose to the automobile manufacturer in the technical report that the harm-minimization recommendation reflects a utilitarian moral philosophy rather than an established engineering standard, identify deontological and other alternative frameworks that yield different outcomes, and affirmatively recommend that the manufacturer implement pre-sale consumer disclosure of the vehicle's harm-allocation decision logic as a condition of ethically responsible deployment Actual outcome
  • Disclose the philosophical basis of the harm-minimization recommendation to the manufacturer's engineering and legal teams as part of the confidential consulting deliverable, but limit the consumer disclosure recommendation to a general advisory that the manufacturer consult legal counsel about disclosure obligations, leaving the public transparency decision to the manufacturer's business judgment
  • Present the harm-minimization recommendation as Engineer A's professional judgment grounded in the NSPE Code's public welfare paramount obligation without characterizing it as utilitarian or labeling its philosophical foundations, on the basis that the Code itself — rather than a contested moral philosophy — provides the normative authority for the recommendation, and defer consumer disclosure questions to the manufacturer and its regulatory counsel
6. If the automobile manufacturer overrides Engineer A's harm-minimization recommendation and programs the vehicle to prioritize passenger safety above third-party welfare, what actions must Engineer A take — and does Engineer A's consultant status alter the scope or sequence of those obligations?
  • Formally document the safety disagreement in writing to the manufacturer's responsible decision-makers, decline to certify or approve the passenger-priority system if it cannot be reconciled with the public welfare paramount obligation, and evaluate whether the foreseeability and severity of third-party fatal harm triggers an external reporting obligation beyond the consulting engagement Actual outcome
  • Document the safety concern in the consulting deliverable, communicate the disagreement verbally to the manufacturer's project lead, and continue participating in the technical optimization of the passenger-priority system while treating the manufacturer's policy override as a legitimate business decision within the client's authority — on the basis that Engineer A's professional duty is satisfied by having raised the concern and that the manufacturer bears ultimate design responsibility
  • Withdraw from the consulting engagement upon the manufacturer's override without formal written documentation of the specific certification threshold crossed, on the basis that the consultant relationship does not obligate Engineer A to pursue multi-tier internal escalation through an organization in which Engineer A holds no employment standing, and that withdrawal itself constitutes a sufficient professional signal of non-endorsement
Timeline Flow

Sequential action-event relationships. See Analysis tab for action-obligation links.

Enables (action → event)
  • Recommend Additional Safety Testing Prepare Transparent Technical Report
  • Prepare Transparent Technical Report Actively Participate in Risk Assessment
  • Actively Participate in Risk Assessment Unambiguously Express Safety Concerns
  • Unambiguously Express Safety Concerns Explore Additional Technical Mitigation Options
  • Explore Additional Technical Mitigation Options Propose Further Study Before Deployment
  • Propose Further Study Before Deployment Safety-Critical_Software_Identified
Precipitates (conflict → decision)
  • conflict_1 decision_1
  • conflict_1 decision_2
  • conflict_1 decision_3
  • conflict_1 decision_4
  • conflict_1 decision_5
  • conflict_1 decision_6
  • conflict_2 decision_1
  • conflict_2 decision_2
  • conflict_2 decision_3
  • conflict_2 decision_4
  • conflict_2 decision_5
  • conflict_2 decision_6
Key Takeaways
  • When regulatory frameworks have not yet caught up to emerging technology, engineers bear a heightened personal obligation to surface ethical concerns rather than defaulting to compliance silence.
  • The prime directive of harm minimization cannot be subordinated to client commercial interests or passenger-priority algorithms when third-party fatal harm is a foreseeable outcome.
  • A stalemate resolution signals that the board identified irreconcilable competing duties, meaning the engineer's obligation defaults to the most protective principle — public safety — as the irreducible floor.