Similar Content + Popular Threads

[+ MysticMenace]

not sure if I was just completely oblivious about the feature, but I just notice that the threads now (or have since had) similar content and popular threads on the side. I think it's pretty nifty - thanks @RadioRob

[+ azdr0710]

I'm sure it can be very helpful much of the time......

but, as usual, the software algorithm can be a bit klunky.....while looking at the "Bend Over" thread in The Gallery, a suggested similar content is the "Mueller Testimony Over" thread in Politics!

[RadioRob]

The Similar Content and Popular Now content is powered by Elasticsearch, which is the tool powering the site search.  

In order to not use a TON of system resources on gathering the similar content data, it's looking at topic titles.  It's not reading the posts themselves for now while I measure the impact on the server load.  (You might have noticed some slowness earlier tonight.  I've spent a good chunk of tonight optimizing how it processes stuff to be much more efficient.)

The reason "Bend Over" and "Muller Testimony Over" matched was because of the phrase "Over".   There was no good matches for "Bend" and the system cannot look at the images themselves.  As we get more and better topic titles, hopefully the Similar Content widget will become more useful.  If not, I can remove it....  for now, it's just an experiment.  

 

[+ azdr0710]

@RadioRob

wasn't complaining, but just making a funny observation!  Thanks, as always, for all your work here!  I wanted to use that gif, too!!

[+ MysticMenace]

On 12/8/2021 at 12:27 AM, RadioRob said:

The Similar Content and Popular Now content is powered by Elasticsearch, which is the tool powering the site search.  

I wonder if we could integrate ElasticSearch in existing forums, so when members try to post new threads, there could be a screen underneath that could show or suggest similar threads that may already be created.

I could imagine something like this scenario...

1. I click "Start New Topic" under The Lounge Forum.
2. I start typing "Porn Actor" under the Title Box
3. Before I even click on "Submit Topic" there'd be a box below the Title Box that could say, "Similar Threads" or "Is This Already Being Discussed?" and it would start suggesting similar threads within that forum, and maybe sorted by relevance or popularity.
4. If it's a new topic or the OP decides to create a duplicate topic anyway (or if there is also a way to show if the poster can no longer reply on an existing topic in the suggestion box), the OP can still click "Submit Topic." 

 

[RadioRob]

I’m playing around with something along these lines but there are a few technical gotchas I need to figure out first. One of the biggest is ensuring permissions are respected when typing in search ahead. (Search ahead is what looks at results as they’re being typed and continually update as the character stream changes.)

I also have to balance this with resource utilization. Eventually if we start making heavy use of Elasticsearch, I’ll want to split it into its own server. (This obviously will have a cost associated with it so also making sure to budget it into our operating costs.)

[RadioRob]

On 12/16/2021 at 4:09 PM, JoeMendoza said:

I wonder if we could integrate ElasticSearch in existing forums, so when members try to post new threads, there could be a screen underneath that could show or suggest similar threads that may already be created.

I could imagine something like this scenario...

1. I click "Start New Topic" under The Lounge Forum.
2. I start typing "Porn Actor" under the Title Box
3. Before I even click on "Submit Topic" there'd be a box below the Title Box that could say, "Similar Threads" or "Is This Already Being Discussed?" and it would start suggesting similar threads within that forum, and maybe sorted by relevance or popularity.
4. If it's a new topic or the OP decides to create a duplicate topic anyway (or if there is also a way to show if the poster can no longer reply on an existing topic in the suggestion box), the OP can still click "Submit Topic." 

 

*cough*