CoCalc Logo Icon
StoreFeaturesDocsShareSupportNewsAboutSign UpSign In
rapid7

Real-time collaboration for Jupyter Notebooks, Linux Terminals, LaTeX, VS Code, R IDE, and more,
all in one place.

GitHub Repository: rapid7/metasploit-framework
Path: blob/master/data/msfcrawler/image.rb
Views: 11766
1
##
2
# This module requires Metasploit: https://metasploit.com/download
3
# Current source: https://github.com/rapid7/metasploit-framework
4
##
5
6
require 'pathname'
7
require 'nokogiri'
8
require 'uri'
9
10
class CrawlerImage < BaseParser
11
12
def parse(request,result)
13
14
return unless result['Content-Type'].include?('text/html')
15
16
doc = Nokogiri::HTML(result.body.to_s)
17
doc.css('img').each do |i|
18
im = i['src']
19
if im && !im.match(/^(\#|javascript\:)/)
20
begin
21
hreq = urltohash('GET', im, request['uri'], nil)
22
insertnewpath(hreq)
23
rescue URI::InvalidURIError
24
# ignored
25
end
26
end
27
28
end
29
end
30
end
31
32
33