MercadoLibre notes risks from integrating autonomous AI agents including unpredictable behavior and reduced oversight.
“We are expanding our investment in AI/ML across the entire Company. This includes using generative AI and continuing to integrate AI capabilities into our products and services. While AI/ML can present significant benefits, it can also present risks and challenges to our business. Because AI/ML is a developing technology, legal frameworks for AI/ML governance are unsettled, quickly developing, and unpredictable. The use of AI/ML could lead to legal and regulatory investigations and enforcement actions, or may give rise to specific obligations, including required notices, consents and opt-outs, under various data privacy, protection and cybersecurity laws and regulations in a number of jurisdictions. Additionally, the integration of autonomous AI agents into our workflows introduces heightened risks related to unpredictable system behavior and reduced human oversight, which could lead to significant operational errors, cybersecurity vulnerabilities, or inaccuracies. Any failure to properly govern or control these autonomous agents could lead to regulatory non-compliance, potential legal liabilities and reputational harm arising from unauthorized or unintended agent actions. Some uses of AI/ML pose emerging ethical issues and present a number of risks that cannot be fully mitigated, including data sourcing, technology integration, bias in decision-making algorithms, discrimination or AI hallucinations, open source software issues, security challenges and the protection of perso”