Australia to Force Social Media Companies to Crack Down on ‘Emerging Harms’ of AI Deep Fakes and Hate Speech

The federal government is set to introduce stringent online safety regulations, mandating social media platforms and technology companies to eliminate harmful content generated by artificial intelligence actively. This includes deep, fake, intimate images and hate speech.

Communications Minister Michelle Rowland has indicated various necessary changes to address the "new and emerging harms" posed by generative AI services. These services, which are becoming increasingly accessible, are being used to create offensive and dangerous digital content, including images, videos, and text.

This move highlights the Labor government's growing concern about the unchecked use of AI in creating and spreading harmful material online.

Communications Minister Michelle Rowland is set to announce a comprehensive review of the Online Safety Act, aiming to expand the rules social media companies must abide by to protect the public. This move comes in response to growing concerns over online threats, particularly those related to AI and hate speech​.

The BOSE Determination, a set of rules guiding online safety, will be expanded. The revisions emphasize the importance of children's best interests as a 'primary consideration' for tech firms.

They will be compelled to act against harmful material generated by AI, including detection and reporting on hate speech​.

A crucial aspect of this legislation is its focus on harmful content, including child sexual abuse material and hate speech. The reforms aim to force tech companies to tackle these issues proactively.

Though largely symbolic, the scope of these fines underscores the government's commitment to holding these companies accountable for the content on their platforms​.

The Australian government is particularly concerned about the misuse of AI in creating harmful content. There's a focus on addressing the creation of deepfakes and other AI-generated materials that could facilitate cyber abuse, harm social cohesion, or spread harmful ideologies like antisemitic and Islamophobic rhetoric​.

Under the proposed changes, social media companies will be required to publish transparency reports detailing their efforts to keep users safe. This initiative is part of a broader strategy to enhance online safety in Australia and ensure that tech companies are accountable for their impact on public safety.

The review will also consider global regulatory approaches, like the duty of care framework being adopted in the UK. This comparison ensures that Australian legislation aligns with international best practices in online safety​.

Australia’s push to regulate social media companies in the face of AI-generated deepfakes and hate speech marks a significant step in online regulation. The government’s efforts to expand the Online Safety Act and implement the BOSE Determination reflect a commitment to protecting its citizens from the harmful effects of unregulated digital content.

This initiative aims to safeguard the Australian public and sets a precedent for other countries grappling with similar challenges in the digital age.