What does the content of the robots txt file tell a web

Last updated: 1/25/2024

What does the content of the robots txt file tell a web crawler Select one O A Which pages of the website it is not allowed to access B Which pages of the website have changed since the last crawl C The order in which it should feed pages to the front queue D The order in which it should feed pages to the back queue O O