MCPcopy Create free account
hub / github.com/apache/solr / crawl

Function crawl

dev-tools/scripts/smokeTestRelease.py:970–982  ·  view source on GitHub ↗
(downloadedFiles, urlString, targetDir, exclusions=set())

Source from the content-addressed store, hash-verified

968
969
970def crawl(downloadedFiles, urlString, targetDir, exclusions=set()):
971 for text, subURL in getDirEntries(urlString):
972 if text not in exclusions:
973 path = os.path.join(targetDir, text)
974 if text.endswith('/'):
975 if not os.path.exists(path):
976 os.makedirs(path)
977 crawl(downloadedFiles, subURL, path, exclusions)
978 else:
979 if not os.path.exists(path) or FORCE_CLEAN:
980 scriptutil.download(text, subURL, targetDir, quiet=True, force_clean=FORCE_CLEAN)
981 downloadedFiles.append(path)
982 sys.stdout.write('.')
983
984
985def make_java_config(parser):

Callers 1

checkMavenFunction · 0.85

Calls 7

getDirEntriesFunction · 0.85
existsMethod · 0.65
appendMethod · 0.65
writeMethod · 0.65
setFunction · 0.50
joinMethod · 0.45
downloadMethod · 0.45

Tested by

no test coverage detected

Used in the wild real call sites across dependent graphs

searching dependent graphs…