AI in Ethical Hacking and Cybersecurity: Offensive and Defensive Perspectives The rise of generative AI (large language models, LLMs) has dramatically changed the cyber landscape, enabling attackers to automate and enhance virtually every phase of an intrusion. Experts note that AI is now “regularly used” in cyberattacks – from automatically generating malware and phishing campaigns to deepfake-driven social engineering – and can even automate tasks like password-cracking and CAPTCHA bypass[1][2]. For example, ChatGPT and similar LLMs can be tricked into finding code vulnerabilities and even writing working exploits in minutes[3][4]. In short, AI tools are a double-edged sword: they can support defenders (in threat intelligence and detection) but also lower the skill barrier for attackers[2][4]. In what follows we survey current offensive uses of AI in hacking – and touch on how AI is also used for defense. AI-Enhanced Brute-Force and Login Attacks Modern brute-force tools use AI to automate and stealthily conduct credential attacks. For instance, BruteForceAI is an open-source penetration-testing tool built on an LLM: it automatically parses web pages, identifies username/password fields, and then carries out multi-threaded brute-force or credential-spray attacks with randomized timing and user-agent strings to mimic human behavior[5]. Likewise, defenders warn that criminals can feed an AI with a target’s public data (social media profiles, etc.) and have it output a prioritized list of likely passwords, supercharging brute-force or password-spray attacks[6]. These AI-driven login tools avoid manual setup and even introduce delays to evade rate limits or lockouts[5]. AI also undermines traditional login defenses. New research shows AI bots can solve CAPTCHAs (image/text challenges) far faster and more accurately than humans[7]. For example, Okta notes that AI solvers have already begun outperforming humans on common CAPTCHA tests[7], eroding one layer of protection. In short, attackers now use AI not only to guess credentials more intelligently, but also to bypass checks (CAPTCHAs, simple 2FA) that were designed to distinguish humans from scripts. This trend pushes organizations to explore passwordless or risk-based logins, since “password” attacks have become automated and AI-augmented[6][7]. AI-Driven Phishing and Social Engineering Attackers are using AI to create highly personalized and convincing phishing and socialengineering campaigns. Generative AI models can scan public profiles and company websites to craft emails, messages or even audio/video lures that sound uncannily real. CrowdStrike explains that “AI-driven phishing attacks use generative AI to create highly personalized and realistic emails, SMS messages, [or] phone communication” designed to trick users into giving up credentials or installing malware[8]. In many cases, an AI chatbot can even carry out the conversation: for example, a cybercriminal might deploy an AI “customer-service” chatbot to interact with dozens of employees in real time, harvesting login data or financial information without human hand-holding[9]. Deepfakes (AI-generated audio/video) are a particularly dangerous twist on phishing. Here attackers use an AI clone of a known person’s voice or face to fool victims. For instance, threat reports describe scenarios where a deepfake of a CEO or celebrity issues urgent instructions: an AI-generated call from a “CEO” might demand an immediate wire transfer, or a realistic video conference chat could prompt an employee to install malicious software. One analysis notes that such deepfake scams “exploit trust and urgency,” e.g. fake CEO calls pressuring finance staff to send money, or fabricated voicemails insisting on urgent payments[10]. Voice cloning is already common: for example, fraudsters have cloned executives’ voices to authorize transactions, and “grandparent” scams now often feature AI-tuned voice messages of relatives in distress[11][10]. These attacks succeed because even attentive users can be fooled by perfect grammar and familiar voices that AI can readily produce. In short, AI has enabled “Phishing 3.0” – scam campaigns that are deeply personalized, multilingual, and delivered by realistic chatbots or deepfakes[12][13]. Cyberwarfare context: State-aligned actors also leverage AI-enhanced social engineering in conflicts. In the Russia–Ukraine war, researchers report that Russian-linked groups run hybrid campaigns using “AI-enhanced phishing and deepfakes” to demoralize the population and compromise military personnel[14]. Ukrainian officials likewise warn that generative AI allows disinformation and phishing narratives “to be multiplied and distributed on a new more complex level”[15]. In one example, U.S. authorities disrupted a “Generative AI-enhanced social media bot farm” run by Russian operatives – an automated network of fake personas used to spread propaganda at scale[16]. These cases show that AI-driven disinformation is now a front-line tool in modern cyber warfare. AI-Powered Malware and Ransomware AI isn’t just for communication – it’s increasingly used to create and adapt malware. Researchers have demonstrated that ChatGPT-like models can write working malware scripts with little user input. In underground hacking forums, attackers have shared ChatGPT-generated Python stealers, PowerShell scripts, and even polymorphic malware (code that mutates on each run to avoid antivirus)[17]. In other words, AI is “democratizing” malware: tasks that once required expert programmers can now be done by anyone who can prompt a chatbot effectively[17]. For example, one team used ChatGPT to generate a full exploit in under an hour, with the AI explaining its steps as it went[4]. The ransomware field is also seeing AI innovation. In 2025 ESET announced “PromptLock”, a proof-of-concept GenAI ransomware that runs an on-device language model to decide its actions in real time[18]. PromptLock generates malicious Lua scripts on-the-fly: during an infection it scans each file’s content and – based on its prompt instructions – autonomously chooses whether to exfiltrate or encrypt it[18][19]. In effect, the AI decides the attack trajectory, making the malware self-adaptive. As ESET researchers warned, “launching sophisticated attacks has become dramatically easier” with AI – “a wellconfigured AI model is now enough to create complex, self-adapting malware”[20]. Similarly, another report found that a Chinese-linked group used Anthropic’s Claude AI agent to automate a cyber-espionage campaign: the AI carried out 80–90% of the operation (reconnaissance, vulnerability scanning, exploitation, lateral movement) at machine speed[21][22]. These incidents underscore a shift: AI can autonomously develop and evolve malicious code, severely challenging defenders. Even non-ransomware malware is AI-enhanced. CrowdStrike notes that AI-enabled attacks can research targets and vulnerabilities automatically, adapting malware payloads to evade detection[23]. In practice, AI may generate obfuscated code, tweak encryption, or craft malicious macros for delivery: for instance, attackers have fed ChatGPT tasks like “write a VBA macro that runs silently” and gotten malicious macros without the usual human effort[24]. In sum, AI tools are now used to script entire malware campaigns – from payload development to infection strategy – with minimal operator input. AI in Vulnerability Discovery and Exploit Generation Relatedly, AI accelerates the red‑team (ethical hacking) workflow of finding and exploiting bugs. Security researchers have shown that an LLM can flag coding flaws when primed correctly: e.g. by telling ChatGPT that a task is for a security test, one can get it to identify buffer-overflow weaknesses in provided code[3]. Attackers then coax the model to output code snippets (in stages) that collectively form a working exploit. Indeed, a proof-ofconcept demonstrated that hackers could use ChatGPT to craft a real exploit for a popular application in under an hour[4]. Going further, “AI agents” (LLMs connected to tools) have begun to carry out portions of cyberattacks with little human help. In the Anthropic/Claude case mentioned above, the AI agent autonomously triaged hundreds of targets, scanned for known vulnerabilities, and executed exploit attempts at machine scale[21][22]. This level of automation (“the first reported use of AI to direct a hacking campaign”[22]) shows how attackers can string together reconnaissance, penetration testing, and post-exploit tasks using AI as the operator. In sum, AI now speeds up vulnerability research and exploit development, making sophisticated offensive steps almost as easy as a series of well-crafted prompts. AI-Enabled Fraud and Deepfake Impersonation Generative AI also fuels financial and identity fraud. Attackers use LLMs to create synthetic personas and content at scale. For example, deepfake videos and images are used to imitate executives or influencers in advance-fee scams, and AI can generate forged documents or fake IDs. Threat reports note that deepfake scams surged by hundreds of percent in finance and crypto sectors, with victims tricked by AI-generated “celebrity” endorsements or CEO video appeals[25]. Voice cloning has similarly exploded: fraudsters clone a CEO’s voice in real-time to authorize wire transfers, or imitate a grandparent pleading for money on the phone[11]. In other words, any trusted public figure (even ordinary individuals) can have their likeness “borrowed” by AI for fraud. LLMs like WormGPT and FraudGPT (underground models fine-tuned for scams) are explicitly built to write scam emails, phone scripts, and social media content that fool victims[12][25]. These AI-driven frauds are effective because they remove the typical errors of human scammers. A generative model produces flawless grammar and style, making phishing emails indistinguishable from legitimate ones in any language[26]. Likewise, AI-crafted voice or video has no telltale artifacts to alert naive targets. In sum, AI dramatically increases both the scale (mass personalization) and believability (deepfake realism) of fraud campaigns[12][11]. AI in Defense and Cybersecurity Defenders are fighting back with AI of their own. Machine learning and AI-driven tools now power much of modern cybersecurity: by analyzing vast telemetry they can spot novel threats faster than humans. For example, AI can learn a network’s normal patterns and flag anomalies (an unusual login location, a spike in traffic, odd process behavior) that might indicate a breach[27][28]. Studies show AI-based detectors can “identify subtle signs of malicious activity” by adaptive learning from past incidents[28]. Similarly, AI-based email filters use natural-language processing to examine tone, language and intent, catching sophisticated phishing lures that static rules would miss[29][8]. Leading cybersecurity frameworks now advocate AI-powered hygiene and response. MIT Sloan recommends a multi-layered defense combining automated security hygiene (selfhealing code, continuous patching, zero-trust architectures) with autonomous defensive systems and human oversight[30]. In practice this means using ML for continuous vulnerability scanning and patch management, deploying AI-deception techniques (fake assets to lure attackers), and leveraging AI threat intelligence for real-time alerts. Industry analysts note that “the best defence against AI is AI”: organizations that adopt AI-driven security (user‑behavior analytics, automated incident response, predictive threat hunting) stand the best chance of outpacing AI-powered attacks[31][30]. In summary, AI is reshaping cybersecurity on both sides. On offense, generative models automate and enhance social engineering, vulnerability discovery, malware creation and even large-scale cyber campaigns. On defense, AI is the new force multiplier for detecting and responding to these advanced threats. Ethical hackers and security teams will need to master these AI tools themselves – using them to test systems (as red teams) and to bolster defenses – in order to keep pace with this rapidly evolving threat landscape[30][31]. Sources: Authoritative industry reports and research analyses were used throughout. (E.g. CrowdStrike, Okta, ESET, MIT Sloan, Reuters, DOJ, academic reviews, etc.) All factual claims above are cited to the connected sources[5][6][8][18][3][21][14][16][30], etc. [1] [30] AI cyberattacks and three pillars for defense | MIT Sloan https://mitsloan.mit.edu/ideas-made-to-matter/ai-cyberattacks-three-pillars-defense [2] Generative AI in cybersecurity: A comprehensive review of LLM applications and vulnerabilities - ScienceDirect https://www.sciencedirect.com/science/article/pii/S2667345225000082 [3] [4] [17] [24] [26] Hacking with ChatGPT: Five A.I. Based Attacks for Offensive Security | by Tahir | Medium https://medium.com/@tahirbalarabe2/hacking-with-chatgpt-five-a-i-based-attacks-foroffensive-security-2baf18a4fa17 [5] BruteForceAI: Free AI-powered login brute force tool - Help Net Security https://www.helpnetsecurity.com/2025/09/03/bruteforceai-free-ai-powered-login-bruteforce-tool/ [6] [7] [31] How cybercriminals are using gen AI to scale their scams https://www.okta.com/fr-fr/newsroom/articles/how-cybercriminals-are-using-gen-ai-toscale-their-scams/ [8] [9] [13] [23] Most Common AI-Powered Cyberattacks | CrowdStrike https://www.crowdstrike.com/en-us/cybersecurity-101/cyberattacks/ai-poweredcyberattacks/ [10] [12] Phishing 3.0: AI and Deepfake-Driven Social Engineering Attacks https://www.cm-alliance.com/cybersecurity-blog/phishing-3.0-ai-and-deepfake-drivensocial-engineering-attacks [11] [25] The Dark Side of Artificial Intelligence https://www.threatmark.com/the-dark-side-of-artificial-intelligence/ [14] ceur-ws.org https://ceur-ws.org/Vol-4110/paper24.pdf [15] Russia using generative AI to ramp up disinformation, says Ukraine minister | Reuters https://www.reuters.com/technology/artificial-intelligence/russia-using-generative-airamp-up-disinformation-says-ukraine-minister-2024-10-16/ [16] Office of Public Affairs | Justice Department Leads Efforts Among Federal, International, and Private Sector Partners to Disrupt Covert Russian Government-Operated Social Media Bot Farm | United States Department of Justice https://www.justice.gov/archives/opa/pr/justice-department-leads-efforts-amongfederal-international-and-private-sector-partners [18] [19] [20] ESET discovers PromptLock, the first AI-powered ransomware | | ESET https://www.eset.com/us/about/newsroom/research/eset-discovers-promptlock-thefirst-ai-poweredransomware/?srsltid=AfmBOopRWxeab69BIlU6oYd5RjM066JJMbOXD_K9heWs7aDZkx0Vh RBv&ref=blog.hunterstrategy.net&srsltid=AfmBOopXdDX7S3aADR_xVB9MIeoA5sC6f0Nlq 9KXH7oO27kTVwqpvt-1 [21] The Rise of AI-Driven Attacks: Anthropic's Event and PromptLock as a Turning Point | Morphisec Blog https://www.morphisec.com/blog/the-rise-of-ai-driven-attacks-anthropics-event-andpromptlock-as-a-turning-point/ [22] Anthropic warns of AI-driven hacking campaign linked to China | Technology News | Al Jazeera https://www.aljazeera.com/economy/2025/11/14/anthropic-warns-of-ai-driven-hackingcampaign-linked-to-china [27] [29] AI in Cybersecurity: How AI is Changing Threat Defense https://ischool.syracuse.edu/ai-in-cybersecurity/ [28] What Is the Role of AI in Threat Detection? - Palo Alto Networks https://www.paloaltonetworks.com/cyberpedia/ai-in-threat-detection
0
You can add this document to your study collection(s)
Sign in Available only to authorized usersYou can add this document to your saved list
Sign in Available only to authorized users(For complaints, use another form )