com.esri.gpt.framework.robots
Interface Bots

public interface Bots

Represents access policy from a single "robots.txt" file.

See Also:

Access, BotsUtils

Method Summary

Integer	getCrawlDelay() Gets crawl delay.
String	getHost() Gets host.
MatchingStrategy	getMatchingStrategy() Gets matching strategy.
List<String>	getSitemaps() Gets sitemaps.
String	getUserAgent() Gets user agent.
WinningStrategy	getWinningStrategy() Gets winning strategy.
List<Access>	select(String path, MatchingStrategy matchingStrategy) Selects matching accesses.

Method Detail

getUserAgent

String getUserAgent()

Gets user agent.

Returns:

user agent

getCrawlDelay

Integer getCrawlDelay()

Gets crawl delay.

Returns:

crawl delay in seconds or 0 if no delay

getHost

String getHost()

Gets host.

Returns:

host or null if no any available

getSitemaps

List<String> getSitemaps()

Gets sitemaps.

Returns:

list of sitemap urls.

getMatchingStrategy

MatchingStrategy getMatchingStrategy()

Gets matching strategy.

Matching strategy defines how it is determined if a requested URL is matching a pattern.

Returns:

matching strategy (never null)

getWinningStrategy

WinningStrategy getWinningStrategy()

Gets winning strategy.

Winning strategy defines how a single matching path is selected amongst a list of matching paths.

Returns:

winning strategy (never null)

select

List<Access> select(String path,
                    MatchingStrategy matchingStrategy)

Selects matching accesses.

Parameters:

path - path

matchingStrategy - matcher

Returns:

list of matching accesses (newer null)