api: 503 from cloudflare?
Closed this issue · 6 comments
jahamed commented
Even if I do a simple curl on the api I'm getting 503/cloudflare error. Is this a bug/configuration on the server side or is there something I'm missing in my requests? Thanks!
curl https://filterlists.com/api/directory/lists works from my laptop, but if I run this in a docker container it errors out with a 503, hitting a cloudflare page:
<!DOCTYPE html>
<html lang="en-US">
<head>
<title>Just a moment...</title>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
<meta http-equiv="X-UA-Compatible" content="IE=Edge">
<meta name="robots" content="noindex,nofollow">
<meta name="viewport" content="width=device-width,initial-scale=1">
<link href="/cdn-cgi/styles/challenges.css" rel="stylesheet">
<meta http-equiv="refresh" content="35">
</head>
<body class="no-js">
<div class="main-wrapper" role="main">
<div class="main-content">
<h1 class="zone-name-title h1">
<img class="heading-favicon" src="/favicon.ico" alt="Icon for filterlists.com"
onerror="this.onerror=null;this.parentNode.removeChild(this)">
filterlists.com
</h1>
<h2 class="h2" id="challenge-running">
Checking if the site connection is secure
</h2>
<noscript>
<div id="challenge-error-title">
<div class="h2">
<span class="icon-wrapper">
<div class="heading-icon warning-icon"></div>
</span>
<span id="challenge-error-text">
Enable JavaScript and cookies to continue
</span>
</div>
</div>
</noscript>
<div id="trk_jschal_js" style="display:none;background-image:url('/cdn-cgi/images/trace/jsch/nojs/transparent.gif?ray=7939b5e0cccb38b1')"></div>
<div id="challenge-body-text" class="core-msg spacer">
filterlists.com needs to review the security of your connection before proceeding.
</div>
<form id="challenge-form" action="/api/directory/lists?__cf_chl_f_tk=godj7TNpyOR5Ii5wI3unB7awxrjwaeZCENIlP37Whec-1675412039-0-gaNycGzNB70" method="POST" enctype="application/x-www-form-urlencoded">
<input type="hidden" name="md" value="mk.n8OLkT9Wq5G1lHgqhlk.9ygseJrA9tcp43PiKhcc-1675412039-0-AR9wTvJ_mIOj71ZdWXVMcDTp1S7c4Vh7ErCMvUQt15sP5p4-5venxTtfTU5SAn_PAOPEpr-LQUkN29rEwyd5FRY9QQo1QR5RPcoaQ-2NArZ01GB4BCD8w1bmgfkB0TpfhhmhBhRRDGxF8e_YSJIOBy7x_z8DOYDp5ris6V5gw8w9NL80CdL_1ECsPfdyRzcIbtS42n2MNVDJtQOeKig3g_W6f-pHovhfFZSgfDDZJjlAd1P0vT4kfqnSH32N17FQU8jU76SXj-3yvEjwn7j-uvk-dkuzaiCYOi0NsTcwD6EGRGGZIBeSBLraihctHJMeOEMZp1DwC54ilQZAvt2N9ZseBvJpHn9j1uVKlZ1a9si2bc8z2ecrC9_f3Q8heDdWdX3CAQnLqthJhULvaISPKJm0l-9wO_gyCsQpU1VkZF1--qpoZWw3ynFSPxzy6kyUgDUzSJBVYclBVWbh1EShk7hiKGDgjE_YZ_wjAY2PjT6f">
<input type="hidden" name="r" value="xbTRr6AcJc0k5a5PHAg_4hFEJK6Vhb32pNiq_LToVKw-1675412039-0-ATLSsxI7uKI/Xolc3mBFu8N4sxhKMMHa3KzWCtIOkLb4RLFMBXdS+Na7tBTACUwgQWTN/KTUwQ5TT4G0INhYuCh1d9G4ri/E2C2oa846PDp9NKt1UHqmuIghM93sNDeDnXUCgsyIe+ScC0f/g2lztR0LeuEiNTGmxn6hCsL7GdqFCBk5RxwCEY5mhl7I5bislz0sIAbUXwcuDSiOQxhUEopSRL5eR/9zR103652y3oK8AFVEvTpAtl7rVuJcFH1wduaDlurA+4qPpzKidSgvncojfu8bx/pGoQyCYZxjFQxRd6RF4IOMa5ZBOEC1B4RY/owqh4leEi+ul/d7fUbi7LYe+0p02v+5VptGxZ1NfMlKGclY/CFESBYO81jp/BFrMtti4vnkW5JrE9LF1skH5fcQpL/rAJDhLloc07NzrWJksi6O/gk52TAM7So//V00tIX4ktcSEjxetqHwHxURmREKNQ2IMe+hZJMzPI5yXDGy8dFTYzPYlzAf4JUODKD9fbAqfAW4Tv829tqki2Sqt6AE3c+goNaEhGihvCr6f4FsV/V+WSRBExNrmnXQXRD9Bl6kXU+IY76LrZLUYrjF676NlHLBUmNwSyv5PuqtyMFqhXN4lgtAR3y3pQH8qzZbnknVj62qfWFX8iwyJBgKez/RWcTiXMNfUOAeha0RnnwKihhgj5fuvvqqjzP9Y0NceK3SlScSZ7nTexlZnPr7o1UhOiP7lGBAyhUMwGvIYONyq/B7121rQc0zgtOoyJGVHkW9p7KyxCPEMxPjHYW7Gc73BmnF5MvtAz+6xcerBTzGuWXQLTHbOQBPUuCZWfeP0RK0WtKFR2oKRdpNRFwkyZYUcs5sIf8PntiIfhmbl80AyDBECd//P7Hw2N3ce/ldWcTyyr2/yxAgSCezKWgQEIC3let5qBJoSpHHpbFdTKxLapQEPvAPLOFj86TcpclYl9GhcIHeQ57Pp/ceoZRNDEvHouteAd0lPlsIL+C5X2TJmVFH+zIPlpFC7Dy0xZ6Zp+joxJErgCDjDfaKFXb2mQ+n0yd/bvST/AIOltmaWb5GYOFh/nwEt2Wc6ZTgqwVEktfVxT8o4Ct2TPhkaaP7Hizu/BYOeAFn9hqGO+NvenlHUypzPrZrg35uSD/8l4/eMa5gnJXwJ50+304Xdo+axPIvn0WR8GkvoHiTPCjRGRzlAYvXEehqd2rTHNtriP0PW5JPFfeSC6XRMLFOPbGyi5gQfYHbZQhDGtdUiI37Ussitpo/nVTpwzv53Tcfukq1q5tHCZBaNOSJYDN84f08XEqYNS96PdgcipQinlvAny6HNpoQizS4M0M/in6LqYsrz68TmMcugH6POAL6sZ2MONxJ6AGyTAYOEyuRAzB7uV8Rm0ZbhGj9i7UoKZYkcFQg3PK/55lOBwv6zc1H0qPZqjfuA87Jt20RDVCMqzVTPGNSJGzCIj4StTw6R/EUBe1TwckbiHt4cIIUxrUgq3wVxGvHHnqdsThBVA8oWKnUWj3GNQH9ijqXHC2VB+8IxI1cmD+12Qrzie6zLvu+tg+xSVGFA4XP0y5saotr3Lc3/QyMzKoRxo2tO2M6I6HPAlwe7IjXcWKUgemBZgA/+jvegXGZKt+2x9X+dzj/5lZ0PP2Mdvyn0nZQtCTp6i4z0uxJlzqUdkdT/ZFZ1nMHKfqPiHzgF8tBt5aM8RJ7wu5yw2pBfPJW2cDvmooYgWAaJcmnxzLaUZn484ab2GCXruONuk+O4yHZhnAwqKbkgNM533KXKourT/Fi3Q3B08AnVtJSNnngsrWtnF3dSKwQ8t/hLEIzgkSiTys2NwWVAFN5TiJ53VCs6aXkRZBOEKekqQFhOxHkFV3k9arOzDNk73BBkThIxcN3MiWkypEI/AcHLEEwFBSwaUIMbRineEL05s1GKA==">
</form>
</div>
</div>
<script>
(function(){
window._cf_chl_opt={
cvId: '2',
cZone: 'filterlists.com',
cType: 'non-interactive',
cNounce: '60764',
cRay: '7939b5e0cccb38b1',
cHash: 'bba471748d1e55c',
cUPMDTk: "\/api\/directory\/lists?__cf_chl_tk=godj7TNpyOR5Ii5wI3unB7awxrjwaeZCENIlP37Whec-1675412039-0-gaNycGzNB70",
cFPWv: 'b',
cTTimeMs: '1000',
cMTimeMs: '30000',
cTplV: 4,
cTplB: 'cf',
cRq: {
ru: 'aHR0cHM6Ly9maWx0ZXJsaXN0cy5jb20vYXBpL2RpcmVjdG9yeS9saXN0cw==',
ra: 'TW96aWxsYS81LjAgKE1hY2ludG9zaDsgSW50ZWwgTWFjIE9TIFggMTBfMTVfNykgQXBwbGVXZWJLaXQvNTM3LjM2IChLSFRNTCwgbGlrZSBHZWNrbykgQ2hyb21lLzEwOS4wLjAuMCBTYWZhcmkvNTM3LjM2',
rm: 'R0VU',
d: 'Uev6GzxqECOgFhDlY19abCsUXNemB95OTu7wUJtsfe5ktrnT9z8ADPunyT78AdjzLrLOgIkhsL/PGbQFyZATQACMQAcuBb4SMavLHmKl85sRpcSG8LecSMpBEveBQ2RYgLDx6tG5mbqyViJHk1mD/N7NKqI+psutSO7xVNaj7cRC3JFaecK0Xjbd4r6c+10H7oKV/c4O7v/VnzPYg3B0RjBirvsBC+aX/4qThU7M30dUMFysHfoTE+a66GiJe+xrVAbItSe/4CC24AAJ5LAYhu8bL/A3VSWI4caIHdwQpC8svQh7TA2pYlHnCU89+zJmldI/QKqfUICjDaGKIFnXFBr0KXGHL1ukCqGd1Dd6tpid03MybNG1F68bo2OERkkaau1MR86DYVs/24Pk3BVGqoCyFgN6DUb5YcFLtzHS1HVg/+gXmn6Eh4XZ2yj3C1rmz12q7uNwk5Uyasswpj0VpuBGGRdD6xgea7XEFr5SoPnvdOgHY5eT5OhVuiP9PjEM9w4zcfDdkCcpTP+R85EOMgeeSEP/W8jhdZ6Spr8I1OpiJ0z09ri1gbdGM837VJ3MC62U99bX1UlWmRwoLTBm+q3sijBk9UpaxJBWKTZTffIw1lXBLxqzy3nn8OyCyf8u+sMxZ/xIhEsyQsKPbrybAA==',
t: 'MTY3NTQxMjAzOS44MDgwMDA=',
m: 'osJDxOoNcssonJ7NkfZdiEWu/uf9lb+DzhR7DSbDkGo=',
i1: 'BwdwzL28n72TJViYews3Wg==',
i2: 'Z7gtXpqcqKZ/Sf3YCvsAAA==',
zh: 'idukNj5ENw75PzB0nNkbPLrajqP/mSu2TobLuTw+muw=',
uh: 'pK/v0YA6+IQC5r4I5liexmThexRcF+/8COLkTAIQMUE=',
hh: '1Sd559bnUYt7/JOLD2t7ppoDbeXy914whLak5UWs9zQ=',
}
};
var trkjs = document.createElement('img');
trkjs.setAttribute('src', '/cdn-cgi/images/trace/jsch/js/transparent.gif?ray=7939b5e0cccb38b1');
trkjs.setAttribute('alt', '');
trkjs.setAttribute('style', 'display: none');
document.body.appendChild(trkjs);
var cpo = document.createElement('script');
cpo.src = '/cdn-cgi/challenge-platform/h/b/orchestrate/jsch/v1?ray=7939b5e0cccb38b1';
window._cf_chl_opt.cOgUHash = location.hash === '' && location.href.indexOf('#') !== -1 ? '#' : location.hash;
window._cf_chl_opt.cOgUQuery = location.search === '' && location.href.slice(0, location.href.length - window._cf_chl_opt.cOgUHash.length).indexOf('?') !== -1 ? '?' : location.search;
if (window.history && window.history.replaceState) {
var ogU = location.pathname + window._cf_chl_opt.cOgUQuery + window._cf_chl_opt.cOgUHash;
history.replaceState(null, null, "\/api\/directory\/lists?__cf_chl_rt_tk=godj7TNpyOR5Ii5wI3unB7awxrjwaeZCENIlP37Whec-1675412039-0-gaNycGzNB70" + window._cf_chl_opt.cOgUHash);
cpo.onload = function() {
history.replaceState(null, null, ogU);
};
}
document.getElementsByTagName('head')[0].appendChild(cpo);
}());
</script>
<div class="footer" role="contentinfo">
<div class="footer-inner">
<div class="clearfix diagnostic-wrapper">
<div class="ray-id">Ray ID: <code>7939b5e0cccb38b1</code></div>
</div>
<div class="text-center" id="footer-text">Performance & security by <a rel="noopener noreferrer" href="https://www.cloudflare.com?utm_source=challenge&utm_campaign=j" target="_blank">Cloudflare</a></div>
</div>
</div>
</body>
</html>
collinbarrett commented
Hmm, based on the ray value of 7939b5e0cccb38b1 in your log, I can see that Cloudflare thinks you're a bot...
How can I fix this... 👀
collinbarrett commented
For now, I have disabled "Bot Fight Mode". Please try again and report back if is still an issue. I think this should resolve it.
Happy to see you using the API. I would love to spend more time beefing up this project and its API, but it's hard to find time. Enjoy!
jahamed commented
Thanks @collinbarrett! Yep it seems to be working now! Totally understand on the time part, still thank you for what's there already!
collinbarrett commented
Great! I'd love to hear what you are building with or using the API for if you ever wanna share.
xarantolus commented
I also got a similar error with status code 403 when requesting the API from GitHub Actions (e.g. here). I'm currently working around it by running the Docker Container locally, as described in the readme. It looks like that also returns up-to-date information, so that might also work for others :)
collinbarrett commented
Ah. Hmm. I bet Cloudflare is flagging your request as possibly suspicious... hmm. I'm glad you found a workaround for now!