Commit Graph

53 Commits

Author SHA1 Message Date
Bryan Ashby f510fca656 Tic File Processor didn't work on nodelist file #111 2017-03-13 20:11:43 -06:00
Bryan Ashby 732e2eefd5 Don't trim() Ldesc; may muck with FILE_ID.DIZ type descriptions 2017-03-10 21:21:09 -07:00
Bryan Ashby 221ec08bc8 * Don't archive non-good non-pkt files (e.g. TICs that are *not* rejected)
* asyncSeries() for TIC import (SQLite transaction)
2017-03-10 21:13:30 -07:00
Bryan Ashby 76aa54f22c Don't try to log error that doesn't exist 2017-03-08 23:01:25 -07:00
Bryan Ashby 57dc7c91ef * TIC import support!!!
* reject/retain paths for FTN networks
* Fix bug in FileEntry.findFiles() with meta pairs
* New well known file meta - mostly related to TIC
* Index of file_sha256
* FileEntry.persist() can update entries
2017-03-08 22:37:02 -07:00
Bryan Ashby be38bbf3c7 Crash on exporting packet #104 2017-03-01 20:02:45 -07:00
Bryan Ashby 4cea9e023a Fix bug with FTN export scheduler 2017-02-21 21:26:56 -07:00
Bryan Ashby f80492d869 Merge branch 'master' into FILE_BASE 2017-02-15 21:46:35 -07:00
Bryan Ashby 690d148ad5 * Move to uuid vs node-uuid
* Use uuid-parse for to/from string
2017-01-31 00:17:19 -07:00
Bryan Ashby 9525afddd3 * Created new npm module: temptmp: This replaces node-temp usage & solves global temp file cleanup issue with concept of temp "sessions" 2017-01-29 19:56:46 -07:00
Bryan Ashby 1c03c3021a * Temporary fix for MAJOR global temp cleanup bug: comment out node-temp .cleanup() methods
* Don't move temp uploads to area directory until user submit/completed
* New file util module
2017-01-23 23:32:40 -07:00
Bryan Ashby 6f3fe7c52d #103: FTN PKT files need to be uppercase 2016-12-06 20:51:48 -07:00
Bryan Ashby 6da7d557f9 * Improvements to ANSI parser
* Introduction of storage tags for file bases / areas
* Expiration for file web server items
* WIP work on clean ANSI (on hold for a bit while other file base stuff is worked on)
2016-12-06 18:58:56 -07:00
Bryan Ashby ec716fdf2c * More file area utility methods/etc.
* Start adding oputil file-area --scan <areaTag> stuff
* New new ArchiveUtil.getInstance()
2016-10-02 21:40:37 -06:00
Bryan Ashby 6a28b3ff35 Dump schedule info @ load 2016-09-19 21:29:46 -06:00
Bryan Ashby 257081b250 Help catch errors in configs easier 2016-08-06 19:57:27 -06:00
Bryan Ashby 9af9bfe3d0 More switch style 2016-08-03 22:43:56 -06:00
Bryan Ashby 359241654b Case insensitive compare for area tags (#78) 2016-07-21 21:04:08 -06:00
Bryan Ashby 5e13a78f31 Minor cleanup 2016-07-19 21:01:25 -06:00
Bryan Ashby 1ecc68b250 Fix erronous warning 2016-07-09 20:10:03 -06:00
Bryan Ashby 3bbdd4abae Check for MSGID explicitly during dupe check if present 2016-07-05 22:32:13 -06:00
Bryan Ashby f87e9917a0 * Resolve issue #59: Better message UUID generation and dupe checks 2016-07-05 22:18:43 -06:00
Bryan Ashby 36ce2354e3 * Functional event scheduler - still some to do, but works
* WIP on message area cleanup via scheduler
* Some const cleanup
2016-06-19 21:09:45 -06:00
Bryan Ashby 1a689805b5 Fix StateFlags0 -> state_flags0 -- was causing imports to export! 2016-04-14 23:08:54 -06:00
Bryan Ashby 9080b1d0b9 Fix conflict 2016-04-14 22:12:46 -06:00
Bryan Ashby 1113a5f366 Fix some encode/decoding errors with unknown/unsupported encodings 2016-04-14 22:11:01 -06:00
Bryan Ashby 2c0267adf1 Fix assert when looking for MSGID 2016-04-13 21:38:45 -06:00
Bryan Ashby 7278450d9e * Ability to save off imported (and later, exported) packets for debugging purposes via scannerTossers::ftn_bso::retainImportPacketPath config.hjson opt 2016-04-13 21:06:27 -06:00
Bryan Ashby a6d7d41601 FTN/BSN import/export now ignores case in filenames 2016-04-02 09:56:16 -06:00
Bryan Ashby fbf9bc49f9 Better FTN outbound handing of zones...I think 2016-04-02 00:28:25 -06:00
Bryan Ashby 568a138cab * Better logging of import/export stats & schedules
* Some code cleanup
* Remove all mkdirp module stuff -- use fs-extra
2016-03-28 22:07:21 -06:00
Bryan Ashby 434fcdb652 * Fix a few bugs with import - use eachSeries() for packet import to properly handle SQL transaction with 2:n packets 2016-03-28 19:36:09 -06:00
Bryan Ashby 8645cac892 Use fs-extra for move vs fs.rename(), start replace of mkdirp 2016-03-27 23:19:18 -06:00
Bryan Ashby 686573e362 Merge branch 'msg_network' of ssh://numinibsd/git/base/enigma-bbs into msg_network 2016-03-23 21:01:01 -06:00
Bryan Ashby 98e6afa1af * Don't blow up @ message network record() if no network configured for areaTag
* Remove console.log() of message persist; use proper client.log
2016-03-23 20:59:38 -06:00
Bryan Ashby 4e21901be7 * Fix hard line feeds @ FTN import/export
* Retain Origin and tear lines in imported messages
2016-03-22 22:24:00 -06:00
Bryan Ashby d29829a46c * Implemented @watch rule for import schedule
* Implemented @immediate rule for export schedule
2016-03-15 21:44:24 -06:00
Bryan Ashby 964c53ea9f * Changed scan check to use new System state_flags0 meta to skip already imported/exported msgs
* Use moment.js for Message modTimestamp
* Remove user_message_status stuff
* Add REPLY kludge support @ export
* Use TID vs PID kludge @ export (spec)
* Start work on @immediate - nearly complete
2016-03-14 22:29:41 -06:00
Bryan Ashby a787a2eab3 * Fix collsion with import/export temporary dirs; better use of temp dirs all around
* Raw (non-bundle) packet exports are now BSO named (e.g. .cut for crash)
2016-03-13 11:11:51 -06:00
Bryan Ashby 86c659849c * Flow file creation for exported bundles based on node configuration - 'crash' is currently the default 2016-03-12 00:22:06 -07:00
Bryan Ashby 31ca7d3eaf * Don't export imported messages
* Some basic code cleanup
2016-03-09 22:32:00 -07:00
Bryan Ashby ad0296addf * Change FTN packet read() to use async iterator
* createMessageUuidAlternate(): Mmethod for FTN message v5 UUID generation when no MSGID to work with
* parseAbbreviatedNetNodeList() now works properly
* Add core/uuid_util.js for various UUID utilities such as v5 named UUID generation
* Fix message meta load/retrieval
* Add lookup for REPLY kludge -> MSGID -> local reply IDs
* Fix SEEN-BY additions @ export
* Don't override MSGIDs if they already exist
* Store MSGID @ export so it can be inspected later
* Add import functionality (working, but WIP!)
* Clean up bundles and packets after import
2016-03-08 22:30:04 -07:00
Bryan Ashby 6094bed07f * Use node-temp for temp file creation, cleanup, etc.
* Lots of WIP on FTN BSO import
* Fix double callbacks in ArchiveUtil
* Impl ArchiveUtil.extractTo()
* Update bunyan
2016-03-03 22:54:32 -07:00
Bryan Ashby 5c324788fe * Minor work on FTN/BSO import
* Minor work on message network docs
2016-03-01 22:42:29 -07:00
Bryan Ashby 662d3f232e * Use key name for configured archiver name (e.g. "zip")
* Start WIP on mesasge import/toss via schedule
* Defaults for message network name
2016-02-29 22:32:51 -07:00
Bryan Ashby 1a6af18801 Update area scan ID after successful export 2016-02-28 22:35:43 -07:00
Bryan Ashby 76bbc43600 * Start work on FTN/BSO schedule via later.js
* Utilize last scan message ID to scan areas
* Lots of changes to FTN packet creation
* Create packets with target max size
* Create ArcMail bundles when configured to do so
2016-02-28 22:04:03 -07:00
Bryan Ashby ae20dc1f7c * Fix FTN packet created date/time & moment stuff 2016-02-23 23:38:05 -07:00
Bryan Ashby 1417b7efdd * Fix messages with no origin line
* Fix end of message/termination detection for FTN packets
* Start of archive support -- one use will be FTN archives
* Work on FTN ArcMail/bundles
2016-02-23 21:56:22 -07:00
Bryan Ashby a858a93ee1 * FTN BSO module: Export to <domain>.<zone> dirs where appropriate
* Code cleanup
* Fix FTN packet header writing
* Add CHRS support to FTN packet I/O
* Change to FNV-1a hash of ms since 2016-1-1 ("enigma epoc") + message ID for MSGID serial number and <packet>.pkt BSO export
* Only write some FTN kludges for EchoMail (vs NetMail)
* If config specifies, call message network modoule(s) .record() method @ persist (WIP)
2016-02-20 17:57:38 -07:00