- Large Language Models (LLMs) are vulnerable to "jailbreak" attacks. - Existing defenses of LLM chatbots can be bypassed using a time-based approach. - Automated jailbreak prompts can be generated with a high success rate. - Findings have been responsibly disclosed to service providers.
- Almost a third of companies are using generative AI in at least one business function. - High performers attribute at least percent of their EBIT to AI adoption. - Companies need to tackle various issues to ensure a strong return on investment in generative AI. - These issues include identifying opportunities, governance, managing third parties, and understanding risks. - Finding the balance between near-term gains and long-term scalability is crucial.
- Almost a third of companies are using generative AI in at least one business function. - High performers attribute at least percent of their EBIT to AI adoption. - Organizations plan to increase investment in AI in the years ahead. - Majority of respondents report AI-related revenue increases in each business function.
- AI is a tool of power politics and state diplomacy. - EU approaches AI from an economic, social, and regulatory angle. - Discusses the impact of AI on EU's geopolitical power and relationships. - Presents scenarios for how AI may change international balance of power. - Recommends ways for EU and Member States to respond.
- AI is a tool of power politics and state diplomacy. - The EU approaches AI from an economic, social, and regulatory angle. - The paper discusses the impact of AI on the EU's geopolitical power. - It presents scenarios for how AI may change the international balance of power. - Recommendations for the EU and its Member States to respond.
- Researchers are excited about the use of AI tools in science. - AI provides faster data processing and saves time and money. - Concerns include reliance on pattern recognition, bias in data, fraud, and irreproducible research. - AI tools for medical diagnostics can perpetuate bias and false information. - Commercial firms dominate computing resources and ownership of AI tools. - Collaboration with scientists at such firms is considered important. - Researchers using LLMs are still in the minority.
- AI will improve healthcare, farming, climate change mitigation, and more. - AI poses risks such as opaque decision-making and discrimination. - EU needs a coordinated approach to promote AI development and address risks. - The purpose of the White Paper is to set policy options. - Europe can become a global leader in innovation in the data economy. - AI should be grounded in European values and fundamental rights. - AI can support the Sustainable Development Goals and the democratic process. - Environmental impact of AI systems should be considered. - A common European approach to AI is necessary to avoid fragmentation. - The White Paper presents policy options for trustworthy and secure AI development.
- AI will improve healthcare, farming, climate change mitigation, and more. - AI poses risks such as opaque decision-making and discrimination. - EU needs a coordinated approach to promote AI development and address risks. - The purpose of the White Paper is to set policy options. - Europe can become a global leader in innovation in the data economy. - AI should be grounded in European values and fundamental rights. - AI can support the Sustainable Development Goals and the democratic process. - Environmental impact of AI systems should be considered. - A common European approach to AI is necessary to avoid fragmentation. - The White Paper presents policy options for trustworthy and secure AI development.
- SciBERT is a pretrained language model based on BERT. - It addresses the lack of high-quality, large-scale labeled scientific data. - SciBERT improves performance on downstream scientific NLP tasks. - It achieves new state-of-the-art results on several tasks. - The code and pretrained models are available at https://github.com/allenai/scibert/.
- Pretrained language models can generate toxic language even from innocuous prompts. - Controllable generation methods are not failsafe against toxic degeneration. - Web text corpora used to pretrain LMs contain offensive and toxic content. - RealToxicityPrompts dataset created to evaluate toxic generations by LMs. - Recommendations for better data selection processes for pretraining.
- No indication of AI uptake lagging in EU public sector. - Focus on trust, excellence, growth, competitiveness, and quality of life. - Some AI applications in public services banned due to risks. - AI can improve public services, but challenges exist. - Public concern over AI development and use. - Public sector should lead in creating trustworthy AI. - Different definitions of AI in public services. - Explainability of AI systems in public services is crucial. - Automation of decisions or services in public services. - Public services defined as services of general interest.
- NLP work in the past 3 years focused on developing larger language models. - These models have pushed boundaries through size and architectural innovations. - Pretrained models and fine-tuning have improved performance on English benchmarks. - The paper explores the risks associated with big language models. - Recommendations include considering environmental and financial costs, curating datasets, and exploring research beyond large models.