The use of a crawler to extract data from a website may be done legally in relevant business relations. Under certain circumstances and in some specific jurisdictions, crawling may be in conflict with applicable regulation or in violation of the particular terms of service of the crawled site. Therefore, prior to engaging in crawling activities of any sort, you should consult with a lawyer authorized to provide legal advice in your particular area, and carefully read the applicable terms of service.
Categories
Categories
<% if (categories.length > 1) { %>
<% categories.forEach(function(category, index) { %>
<%= category.name %>
<% }) %>
<% } else { %>
<% sections.forEach(function(section, index) { %>
<% if (category.sections.length) { %>
-
<% category.sections.forEach(function(section) { %>
- <%= section.name %> <% }) %>
<%= section.name %>
<% }) %>
<% } %>
<% if (section.sections.length) { %>
-
<% section.sections.forEach(function(section) { %>
- <%= section.name %> <% }) %>
-
<% section.articles.forEach(function(article) { %>
- <%= article.title %> <% }) %>