UESPWiki talk:CSList

Availability

Until now basically only UESP editors and patrollers have known about CSList. I've decided after some soul-searching to lift the veil of secrecy on CSList and see what happens. I think there are a lot of regular contributors who could probably make some constructive use of CSList (including some admins and patrollers whose email is not enabled, and therefore couldn't be told about it).

For now, the only access-related change that I've made is to robots.txt and other restrictions that will prevent google and other search engines from trying to index any of CSList's contents. I'm also assuming that the non-user-friendliness of CSList will discourage its use by non-motivated people who stumble across it. Yes, that's somewhat intentional. I don't personally want to invest a ton of time into making CSList user-friendly. I've got other tools in the works that will provide a useful way for casual readers to view some of the database information.

Hopefully I won't regret this decision... if it comes to it I can add access controls based on wiki accounts, but doing that will just take time away from other, more productive projects I'd rather be working on. So, if you've stumbled across this page, feel free to check out CSList, but don't complain if it's all horribly confusing ;) --Nephele^Talk 01:21, 10 January 2012 (UTC)

Errata

Minor accuracy points, just to have them documented somewhere:

• Enchantment costs are wrong in the autocalc case (marked as red/unverified there), consequently the cost/use values given for weapons using those are wrong. [probably the gold value calculations can be used]
• The leveled flag for locks at references is wrong (marked red). [ flag is documented here at XLOC ]
• The health/mag/sta formula for leveled NPCs in the case of a PC lvl multiplier != 1 is wrong [should be "...(PC-1/mult)..." and not "...(PC-mult)..."].

--Alfwyn (talk) 21:21, 14 December 2012 (GMT)

Current issues can be found here. --Alfwyn (talk) 15:00, 2 February 2014 (GMT)

REFR browsing for Skyrim

So, I wanted to see the REFR records for Skyrim, but it only shows about 500, while on the left-side menu it indicates there are thousands of them? Sergio Morozov (talk) 15:20, 26 January 2013 (GMT)

There are only about 500 in the CK, so the number on the left is incorrect, as far as I can tell. So no data is missing, just a little incorrect number. Vely^►t►e 17:33, 26 January 2013 (GMT)

I looks like CSList only shows map-marker REFS for browsing. Counting all REFS with the add-ons there are about 850,000 - listing them all is not really practicable. If you know the formid of one, you can look it up however. One more thing I just see, the numbers on the left count Skyrim.esm stuff only and don't include add-ons - but add-on data is included when browsing. --Alfwyn (talk) 17:49, 26 January 2013 (GMT)

Actually CSList only showed references that had a full name set. I changed that now for Skyrim to show all references that have either a full name or an editor ID set. This should show all the more interesting references without a total overkill (about 12,800 now). Browsing them seems to have become a little slower, but still tolerable. --Alfwyn (talk) 16:45, 30 January 2013 (GMT)

CSList Not Loading?

As the title suggests, I'm currently having issues with loading pages in CSList. It's somewhat strange as I've never had issues with it in the past and certain pages, such as [1] [2], will load properly but others will not ([3] [4]). For 3 and 4, it loads the particular game name, the search bar, and all the categories on the left, but not the specific information for that given entry. Any help will be very much appreciated, Forfeit (talk) 15:27, 21 May 2013 (GMT)

Yeah, I'm seeing the same thing, actually. My only guess would be that the server is having some kind of issue; I noticed Daveh blocked a couple of IPs that were abusing connections to CSList, so maybe that has something to do with it. ⇠eshe^talk 16:45, 21 May 2013 (GMT)

I thought it was just bots ignoring robots.txt and getting 'stuck' in the CS list but it appears like there's an issue with the database server being stalled on content3 causing some queries to be queued and never delivered (unsure why only some). I'm trying to restart MySQL on content3 which might fix things, at least temporarily, depending on what the issue is. -- Daveh ^(talk) 17:35, 21 May 2013 (GMT)

Problem was a corrupted table in the forum database. Once this was repaired the database issue went away and the problematic queries above now work. If there's still any issues just let me know. -- Daveh ^(talk) 17:42, 21 May 2013 (GMT)

Unofficial patches?

Would it be possible to upload the data from the unofficial patches to CSList? There have been several times when I've wondered, as an XBox editor, if it was because of an unofficial patch when someone on PC was reporting a different game event. It would be useful to be able to check CSList and see exactly what scripting changes the unofficial patches were making. --Morrolan (talk) 15:14, 9 October 2013 (GMT)

Its prolly possible (the creator of the cslist, Nephele, is currently inactive but I assume someone has access to it) but I'd be against it. I think it would cause confusion, as the cslist would no longer show the actual game data for console players. I know that you can look at older versions on the cslist, but it seems like too much trouble for little gain. --AN|L (talk) 15:36, 9 October 2013 (GMT)

The Skyrim CSList currently treats Hearthfire, Dragonborn and Dawnguard as mods, and shows their alterations as alternate versions. By default it shows the vanilla Skyrim data. For example, look at this record modified by Dawnguard. (I haven't used the other CSLists, I suspect they work the same way with SI, KotN and the others.) I was suggesting adding the unofficial patches in the same way that the official DLC content is shown. --Morrolan (talk) 15:46, 9 October 2013 (GMT)

MW CSList - Multiple entries with same ID

If searching for "DIAL"-records in the CSList and selecting "Scrib" (e.g. here, first entry), it will bring you to the CREA record instead. Any way to fix/bypass this? -- SarthesArai ^Talk 13:47, 1 November 2013 (GMT)

AFAIK, Nephele is the CSList guru, and she is not currently active. You could try asking on Daveh's talk page; he may have an answer for you. --Xyzzy ^Talk 06:19, 7 November 2013 (GMT)

I have good news and I have bad news. The good news is that with only a small bit of coding, I can get you there, though it's a total hack: you would have to manually add "&rec=DIAL" to the URL. That's not available on our main CSList server at this point, but if you're curious to try it, it's on our development server here. The bad news, as you will probably gather from what you see there, is that one of the earliest notes in Nephele's code is: "Why don't MW DIAL records contain anything?" I don't think I'll be able to get much further, myself. I just don't know enough PHP to make significant alterations, so as Xyzzy suggested, I'd check with Dave and see if he can get further than I can. – Robin Hood  ^(talk) 08:19, 7 November 2013 (GMT)

Just some info, even if it is not immediately helpful. If you look at the MW record dump dates, it was done shortly before Skyrim release, after that it was abandoned in favor of SR, so it isn't as mature as the OB and SR data. In the case of DIAL records, yes they are almost empty. But all the INFO records following that DIAL record in the file contain the actual text and some more information. You can look up the individual INFO records, just the mapping to DIAL records is missing. Now to fix this (part of) the MW data would need dumping again, but the code as is will currently only function for SR and would need tweeking to work with multiple games again - at least that was the state when I looked last at it. --Alfwyn (talk) 23:15, 23 November 2013 (GMT)

(←) I looked into the code again. First, listing the actual dialogue was easier than I thought and worked with the data already in the DB, no new dump needed - see here. But the problem that the edid (NAME field at start of record) is not unique is a bigger issue. For OB and SR CSList uses the formID as unique identifier for all internal links. It tries to use the edid for MW, but that is not unique. The MW engine knows that if "scrib" is found in a CELL, not to look at DIAL records and will place the CREA record "scrib". So the pair record_type/edid would probably be unique. But there are things that have an empty edid too, like most CELLs. While I'm not sure those things are actually linked to in CSList, I guess a safer approach will be to use the internal ordids (like I did in the example link above) for unique links, and the edids just as the displayed text. I'll try to do this for the MW part in the next days. --Alfwyn (talk) 21:20, 3 December 2013 (GMT)

Issue should be fixed now. Reconsidering that ordids are not stable (may change if data is rescanned into DB), I went along RHs fix (using the name 'rectype' since that was already in use in the code) and changed internal Morrowind edid links to specify the rectype. Stuff that hasn't got an edid will need to use ordid for linking, but this was done for INFO records all along anyway. --Alfwyn (talk) 17:18, 4 December 2013 (GMT)

Search results limitations

Not sure if this is the proper place, but when I'm trying to revamp a page, I'm continually running into the problem of the 50-return limit. I do my best to limit my scope, but try doing a cslist search, just for dialogue, in Morrowind for "Nerevar", "Almalexia", "Vivec", or "Sheogorath", or for "Martin" in Oblivion.

Right now, I'm trying to do a dialogue source pull for "legion" for my revamp of the Imperial Legion lore page, and CSList is effectively useless. Vely and Hargrimm were able to help me out with the Morrowind dialogue, but I still need dialogue from Oblivion and Skyrim. I'm sure I can get it, but to keep on having to turn to other editors is getting old. This is just gonna keep on happening. So is there any way to increase the limit and/or get an option to lift it? Minor Edits^{Threats•Evidence} 00:23, 2 February 2014 (GMT)

Here's what I got for a quick search for 'legion' within Skyrim's dialogue. FYI, the way I comb through lore sources for research is nothing more complicated than having the CS dialogue dumps and raw text of the Corpus Tamrielicum in a folder, then using something like Notepad++'s 'Find in Files' function or TextCrawler to search through them all for whatever keyword. I can email you all the raw text files I have (except for Oblivion's dialogue, which I'm still trying to get my hands on) if you'd like. I have to use the CSList for Oblivion for now, so I'd also appreciate a way to get more results (and also more robust results, rather than having to click into each one to see the actual dialogue). Speaking of lifting restrictions, is there any way I can get around having to complete 2 captchas in sequence every time I try and add any external link to a talk page (like right now)? -- Hargrimm^(T) 00:41, 2 February 2014 (GMT)

As a quick and dirty fix, I changed the limit (for dialogue only) to 500. I think, ideally you would be able to page through search results, like you can do when displaying a list of all records of a certain type. Of course having an independent specialized dialogue search might work too. And as a warning, currently the dialogue for Oblivion found in CSList is incomplete (see CSList Errata). --Alfwyn (talk) 14:48, 2 February 2014 (GMT)

Many thanks; that will make my life much easier. Minor Edits^{Threats•Evidence} 19:52, 2 February 2014 (GMT)

Morrowind: Colons/Semi-Colons

When returning the Lord's Mail to Varus Vantilius, I chose Nevermind and got:

"What? You are dangerously close to treason, %PCName. I will ask you once more; Will you give me the Lord's Mail?"

In the game data it says:

"What? You are dangerously close to treason, %PCName. I will ask you once more: Will you give me the Lord's Mail?"

Which is correct? DRAGON GUARD^(TALK) 13:41, 19 September 2015 (UTC)

Always the game data. A semi-colon wouldn't be grammatically correct anyway, so it sounds like a display issue on your end if that's what it looks like in-game. —Legoless (talk) 14:50, 19 September 2015 (UTC)

This happened on at least one other occasion. In my game, it clearly displays a semi-colon (possible font-related issue). By the way (while I'm on the discussion page), what determines whether parts of dialogue receives a blue colour in-game, and why is it underlined instead of coloured blue? I've noticed that when playing, some dialogue is in normal colour, but the site had the dialogue part underlined. DRAGON GUARD^(TALK) 15:17, 19 September 2015 (UTC)

Aryon's "Telvanni Hortator" dialogue regarding the player's gender changes when speaking of Dratha. I wonder what causes underlined "topic" dialogue. I know creating a new female character would take ages to catch up with the point in the main quest. Using a YouTube walkthrough would be easier. DRAGON GUARD^(TALK) 09:12, 7 October 2015 (UTC)

Moved?

Well met! Apologies if this was mentioned somewhere else, but has CSList been moved or discontinued? I was trying to look something up earlier, and typing the cs.uesp.net url or clicking on the CSList template both take me to a wiki that looks unfamiliar. Forfeit (talk) 22:24, 4 December 2021 (UTC)

The Construction Set wiki has been uploaded to cs.uesp.net. CSList is now found at cslist.uesp.net. I'll see if I can change the links. -- SarthesArai ^Talk 22:28, 4 December 2021 (UTC)

Interesting. Thank you! There would now be a small number of old links on scattered talk pages (this page being one of them) that don't go where they're supposed to now depending on how CSList was linked to. I don't think there's much value in fixing them though, unless it would be a very low effort bot job. Forfeit (talk) 23:47, 4 December 2021 (UTC)

I put a notification box at the top of the cs Main Page so that, hopefully, future readers won't be confused. – Robin Hood ^(talk) 03:56, 5 December 2021 (UTC)

Oblivion SPEL Records count

edit: originally posted on UESP Wiki forum

The page Oblivion SPEL Records says there are 1,331 records. I retrieved 1,324 records, seven records short.

There are only 99 records on the first page. Other record types that I have used (like ALCH for potions) have 100 records on the first page.

I played around with the offset element of the URL. &offset=86& retrieves 99 records. &offset=87& retrieves 100 records. I figure that there is an entry that gets counted for the total display but is not retrieved, and that entry may or may not be an actual spell. There are several other offsets that retrieve less than 100 records but I assume if y'all can figure out why this one is wrong, the other six may be for the same reason.

I guess the questions are: Is the listed record count correct or is the records retrieved count correct? And what is causing the other count to be incorrect? Are other Game Data record counts incorrect?

edit: add below record counts

Retrieved SPEL record counts, page by page:
record 0, count 99
record 100, count 100
record 200, count 100
record 300, count 100
record 400, count 99
record 500, count 100
record 600, count 100
record 700, count 99
record 800, count 100
record 900, count 100
record 1000, count 99
record 1100, count 99
record 1200, count 99
record 1300, count 30


          total 1,324

WaffleHouse2t2 (talk) 01:06, 3 August 2023 (UTC)

scroll data?

Is there a game data file for scrolls? Or did I look right past it? WaffleHouse2t2 (talk) 00:48, 19 September 2023 (UTC)

Answer my own question: The BOOK data file also contains scrolls. The Enchantment field starts with "Scroll: ". WaffleHouse2t2 (talk) 20:44, 8 October 2023 (UTC)