Angular 7 issue with SPA and Universal Crawling

Forum Moderators: open

Message Too Old, No Replies

Angular 7 issue with SPA and Universal Crawling

laureng

3:53 pm on Dec 28, 2020 (gmt 0)

Many SEO tools, like Moz and SEMRush, have user agent detection settings that are able to read Universal, but the Single Page Application (SPA) version partially loads on our website before Universal. Because of this, Moz (and search engines) think we have massive duplicate content issues and search engines in general are having problems crawling our site. For example, a recent crawl report said a particular product page (which has about 1,000 words) has 33,000 words and has duplicate content with over 300 other pages, or how we have a crazy amount of canonical URL issues. This makes me believe it's only picking up the SPA version. Has anyone come across this with Angular 7, and what would be the fix? It's hurting our rankings.

not2easy

4:20 pm on Dec 28, 2020 (gmt 0)

Hi laureng and Welcome to WebmasterWorld [webmasterworld.com]

Sorry, I don't use Angular 7 but others here likely do and will be along. I just have a suggestion or two that might be useful. If you have the site listed in GSC, can you examine what they see when you enter some of your more important URLs? That would tell you for certain whether the Google mobile bot is getting the whole page accurately.

If you see that they list blocked resources, be sure that robots.txt is not blocking access to your js files.

NickMNS

5:51 pm on Dec 28, 2020 (gmt 0)

Hello laureng
Welcome to WW.
As with not2easy, I don't have specific experience with Angular but I do use React and have experience generally with Javascript and SPA's. I have a few questions for you.

For example, a recent crawl report said...

Is this report from Moz or some other 3rd party service?
Are you server side rendering your content for Google/Bing bots, or are you depending on their ability to render as they crawl?

Google has made a lot of progress in rendering JS over the past few years and is far ahead of anyone else so far as I can tell. The 3rd party crawling tools are likely not representative of how Google sees your website. I would rely more on what you see in GSC.

Google has also provided a lot information about this, here are a few examples:
Podcasts:
[youtube.com...]

Office hours (Javascript Specifically)
[youtube.com...]

SEO mythbusting video series:
[youtube.com...]

I hope this helps.

phranque

2:34 am on Dec 29, 2020 (gmt 0)

welcome to WebmasterWorld, laureng!

i would start by trying a "fetch as googlebot" for some of these urls in GSC and examine what google's UA sees.