Denied did I say? No, I have leave,
(Example too, and that from them that have
God better pleased by their words or ways,
Than any man that breathes nowadays),
Thus to express my mind, thus to declare
Things unto you that more excellent are.
2. I find that men, as high as trees, will write
Dialogue-wise; yet no man does them slight
For writing so; indeed if they abuse
Truth, cursed be they, and the craft they use
To that intent; but yet let truth be free
To make her sallies [charges] upon you and me,
Which way it pleases God. For who knows how,
Better than he that taught us first to plough,
_________________
10 II Tim. 1:13.
11 I Tim. 4:7.
12 I Tim. 6:11. Bunyan’s objectors were most likely pastors.
THE P ILGRIM’ S P ROGRESS 7
To guide our mind and pens for his design?
And he makes base things usher in divine.
3. I find that holy writ in many places
Has likeness with this method, where the cases
Do call for one thing to set forth another;
Use it I may then, and yet nothing smother
Truth’s golden beams; no, by this method may
Make it cast forth its rays as light as day.
And now before I do put up my pen,
I’ll show the profit of my book, and then
Commit both you and it unto that hand
That pulls the strong down, and makes weak ones
stand.
This book it chalks [marks] out before your eyes,
The man that seeks the everlasting prize;13
It shows you whence he comes, where he goes,
What he leaves undone, also what he does;
It also shows you how he runs and runs,
Till he unto the gate of glory comes.
It shows too, who sets out for life amain
[vigorously],
As if the lasting crown they would attain;
Here also you may see the reason why
They lose their labor, and like fools do die.
This book will make a traveler of you,
If by its counsel you its rules will do;
It will direct you to the Holy Land,
If you will its directions understand;
Yes, it will make the slothful active be,
The blind also delightful things to see.
Are you for something rare, and profitable?
Would you see a truth within a fable?
Are you forgetful? Would you remember
From New Year’s day to the last of December?
_________________
13 I Cor. 9:24; Phil. 3:14.
JOHN B UNYAN8
Then read my fancies, they will stick like burs,
And may be to the helpless, comforters.
This book is writ in such a dialect
As may the minds of listless men affect:
It seems a novelty, and yet contains
Nothing but sound and honest gospel strains.
Would you divert yourself from melancholy?
Would you be pleasant, yet be far from folly?
Would you read riddles and their explanation?
Or else be drowned in your contemplation?
Do you love picking meat? Or would you view
A man in the clouds, and hear him speak to you?
Would you be in a dream, and yet not sleep?14
Or would you in a moment laugh and weep?
Would you lose yourself, and catch no harm?
And find yourself again without a charm?
Would read yourself, and read you know not what
And yet know whether you are blest or not,
By reading the same lines? Oh then come hither,
And lay my book, your head and heart together.
JOHN BUNYAN
THE P ILGRIM’S PROGRESS
THE AUTHOR’S APOLOGY FOR HIS BOOK
WHEN at first I took my pen in hand,
To write this way, I did not understand
That I at all should make a little book
In such a style; no, I had undertook
To make another, which when almost done,1
Before I was aware, I this begun.
And so it was: I writing of the way
And race of saints in this our gospel day,
Fell suddenly into an allegory 2
About their journey, and the way to glory,
In more than twenty things, which I set down;
This done, I twenty more had in my crown,
And they again began to multiply,
Like sparks that from the coals of fire do fly.
Then no, I thought since if you breed so fast,
I’ll put you by yourself, lest you at last
Should prove ad infinitum, and eat out
The book that I already am about.
Well, so I did; but yet I did not think
To show to all the world my pen and ink
In such a style; I only thought to make
I knew not what, nor did I undertake
Thereby to please my neighbor; no, not I,
I did it my own self to gratify.
_________________
1 Probably The Heavenly Footman based on I Corinthians 9:24.
2 Bunyan also refers to his allegorical style, in this and his concluding
poem, as similitude, metaphor, parable, figure, type, fable, and
shadow.
JOHN B UNYAN2
Neither did I but vacant seasons spend
In this my scribble; nor did I intend
But to divert myself in doing this,
From worser thoughts which make me do amiss.
Thus I set pen to paper with delight,
And quickly had my thoughts in black and white.
For having now my method by the end [tail],
Still as I pulled it came, 3 and so I penned
It down, until it came at last to be
For length and breadth the bigness that you see.
Well, when I had thus put my ends together,
I showed them others, that I might see whether
They would condemn them, or them justify:
And some said, “Let them live”; some, “Let them
die”;
Some said, “John, print it”; others said, “Not so”;
Some said, “It might do good”; others said, “No”.
Now was I in a straight [plight], and did not see
Which was the best thing to be done by me;
At last I thought, since you are thus divided,
I will print it, and so the case decided.
For, thought I, some I see would have it done,
Though others in that channel do not run.
To prove then who advised for the best,
Thus I thought fit to put it to the test.
I further thought, if now I did deny
Those that would have it thus, to gratify,
I did not know, but hinder them I might,
Of that which would to them be great delight.
For those that were not for its coming forth,
I said to them, “Offend you I am loath;
Yet since your brethren pleased with it be.
Forbear to judge till you do further see.”
_________________
3 Bunyan is probably alluding to a woman pulling thread from a
spinning-wheel.
THE P ILGRIM’ S P ROGRESS 3
If that you will not read, let it alone;
Some love the meat, some love to pick the bone:
Yes, that I might them better palliate,
I did too with them thus expostulate.
May I not write in such a style as this?
In such a method too, and yet not miss
Mine end, your good? Why may it not be done?
Dark clouds bring waters, when the bright bring none;
Yes, dark or bright, if they their silver drops
Cause by descent, the earth to yielding crops,
Give praise to both, and carpeth [censure] not at
either,
But treasure up the fruit they yield together;
Yes, so combine them both, that in her fruit
None can distinguish this from that, they suit
Her well when hungry; but if she be full
She spews out both, and makes their blessings null.
You see the ways the fisherman does take
To catch the fish, what engines he does make?
Behold! how he engages all his wits,
Also his snares, lines, angles, hooks and nets.
Yet fish there be, that neither hook nor line,
Nor snare, nor net, nor engine can make thine;
They must be groped for, and be tickled too,
Or they will not be caught, whate’er you do.4
How does the fowler seek to catch his game?
By varied means, all which one cannot name.
His gun, his nets, his lime-twigs, 5 light and bell;
He creeps, he goes, he stands; yes, who can tell
Web tunnel app
Training app
Spanish
Latino labor acquisition website
Patio enclosures taking off in Ohio
Zoe life stage n studio Strongsville
Jennifer Way <jennifer.way@vk.ai>
Dan Kasmierski <Daniel.Kasmierski@vk.ai>
Brian O'Keefe <brian.okeefe@vk.ai>
Aaron Smith <aaron.smith@vk.ai>
John Keyerleber <john.keyerleber@vk.ai>
Matt Carpenter <matt@vk.ai>
Day 2
Tuesday 23 August 2022
Managers meeting
- [ ] Jason
- [ ] Scott
- [ ] Jess
- [ ] Eric
Day 6
Monday 29 August 2022
SELECT parse_batch_id AS parse, COUNT(parse_batch_id) AS cnt, process_ended_at FROM collectionframework_linkstate WHERE process_class="AppleStoreSpider" GROUP BY parse_batch_id HAVING cnt>2;
Day 8
Wednesday 31 August 2022
Installed Postman on Legion and got LifeStance to return data
PlanetFitness only works with ScrapingBee, not ScraperAPI
My first PR-duty day
Sept 12
Password
Setting up password from 7:45 - 10:45
…continuation form yesterday
Chris helped me with cf3
vk_django_something=0.5.0
added the “=0.5.0”
Helped vallée for 2 hours with BW3
Sept 14
Pull requests
15m https://github.com/verticalknowledge/cf1-locationsystem/pull/512
10m GitLab
20m GitHub
RCTs
Onboarding: cf3 setup
Retail2 RCT with Eric
Retail data is big with big maintenance
Discovery (Sundays) & Details (Tuesdays)
Retail is no fun
Bill 45m to training
Guidepoint: Evolus
https://jira.vkportal.com/browse/COL-14892
2h research
Sept 15
LifeStance
There's a lot going on with this spider.
The spider runs in two (2) parts: first LifeStanceSpider runs then spawns DigitalLifeStanceSpider.
April
The first run back in April has almost 4000 locations with attributes: url, langs, areas, gender and type; but, the report did not include this data because that information is reported by the second spider which did not run for some reason. So the report contains the default fields from the Location model only.
May
The second run in May is the only one from the 18 total runs that actually spawned the second spider. It contains all the data and is in the correct csv format. For the 6700 link states it collected a little over 5000 locations.
June
The June run had almost 5200 locations and we started to see the data in its current format with the multiple locations in the attributes: “street_address_1”, “street_address_2”, “phone_1”, “phone_2”, etc.
July
July started the weekly runs and the first two had about 5300 locations each. But then the spider encountered parsing errors and collected less than 200 locations each week.
August
In August the spider was collecting 1000 location or more each week but still having the same invalid state parsing issue. Toward the end of the month it began experiencing timeout limits and not collecting anything.
September
With commit 8a684be1 the Sept 9th batch saw a return to data collection with almost 5500 locations but still not generating the correct report because the second spider is still not spawning.
The data in the Sept 9th fetch looked like this:
name "Doylestown, PA – 4259 W Swamp Rd"
url "https://lifestance.com/l…town-pa-4259-w-swamp-rd/"
address "4259 W Swamp Rd, Suite 404\nDoylestown, PA 18902"
phone "6108923800"
The data in the Sept 13th fetch looked like this:
name "Doylestown, PA – 4259 W Swamp Rd"
url "https://lifestance.com/l…town-pa-4259-w-swamp-rd/"
address ""
suite "4259 W Swamp Rd, Suite 404"
city "Doylestown"
state "PA"
zip "18902"
phone "6108923800"
Blocked to Eric, arg!
Local CF3
This is one for ERIC!
Setting up new spider to run:
- [ ] Go to UI Dashboard http://127.0.0.1:8000/
- [ ] Go to spider
- [ ] Go to Settings
- [ ] REFETCH_LIMIT cannot be None, make it 1
Doc
The entire “training” channel in Slack could be in documentation
https://cloudificationzone.com/2021/08/13/notification-system-design/
Читать полностью…
McNeil Palm gave Don the FLA gig
Brandon (young) just got married and pounding Don's door to work
Of all his postures? Yet there’s none of these
Will make him master of what fowls he please.
Yes, he must pipe, and whistle to catch this;
Yet if he does so, that bird he will miss.
_________________
4 Matt. 4:19.
5 Twigs smeared with sticky birdlime used to snare small birds.
JOHN B UNYAN4
If that a pearl may in a toad’s head dwell, 6
And may be found too, in an oyster-shell;
If things that promise nothing, do contain
What better is than gold; who will disdain
(That have an inkling of it) there to look,
That they may find it? Now my little book,
(Though void of all those paintings that may make
It with this or the other man to take,)
Is not without those things that do excel,
What do in brave but empty notions dwell.
“Well, yet I am not fully satisfied, that
This your book will stand when soundly tried.”
Why, what’s the matter? “It is dark [obscure]”, 7 What
though?
“But it is feigned [fiction].” What if that is so?
Some men by words of fiction, dark as mine,
Make truth to spangle, and its rays to shine.
“But they lack solidness.” Speak man your mind;
“They drowned the weak; metaphors make us blind.”
Solidity, indeed becomes the pen
Of him that writes things divine to men;
But must I needs lack solidness, because
By metaphors I speak; were not God’s laws,
His gospel laws in olden time held forth
By types, shadows and metaphors? Yet loath
Will any sober man be to find fault
With them, lest he be found for to assault
The highest wisdom. No, he rather stoops,
And seeks to find out what by pins and loops,
By calves and sheep, by heifers and by rams,
By birds and herbs, and by the blood of lambs;
God speaks to him, and happy is he
That finds the light and grace that in them be.
_________________
6 An allusion to the mythical belief that certain precious gems were
formed in the head of a toad.
7 Ps. 78:2.
THE P ILGRIM’ S P ROGRESS 5
Be not too forward therefore to conclude
That I lack solidness, that I am rude [superficial];
All things solid in show not solid be;
All things in parables despise not we,
Lest things more hurtful lightly we receive,
And things that good are, of our souls bereave.
My dark and cloudy words they do but hold
The truth, as cabinets enclose the gold.
The prophets used much by metaphors
To set forth truth; yes, who so considers
Christ, his Apostles too, shall plainly see,
That truths to this day in such garments be.
Am I afraid to say that holy writ,
Which for its style and phrase puts down [quells]
all wit,
Is everywhere so full of all these things,
Dark figures, allegories? Yet there springs
From that same book that luster, and those rays
Of light that turns our darkest nights to days.
Come, let my carper [critic] to his life now look,
And find there darker lines than in my book
He finds any. Yes, and let him know
That in his best things there are worse lines too.
May we but stand before impartial men,
To his poor one, I dare adventure ten,
That they will take my meaning in these lines
Far better than his lies in silver shrines. 8
Come, truth, although in swaddling-clothes,9 I find
Informs the judgment, rectifies the mind,
Pleases the understanding, makes the will
Submit; the memory too it does fill
With what our imagination does please;
Likewise, it tends our troubles to appease.
_________________
8 Acts 19:24.
9 Infant or allegorical dress.
JOHN B UNYAN6
Sound words I know Timothy is to use, 10
And old wives’ fables he is to refuse;11
But yet grave Paul him nowhere does forbid
The use of parables; in which lay hid
That gold, those pearls, and precious stones that were
Worth digging for, and that with greatest care.
Let me add one more word, O man of God! 12
Are you offended? Do you wish I had
Put forth my matter in another dress,
Or that I had in things been more express?
Three things let me propound, then I submit
To those that are my betters, as is fit.
1. I find not that I am denied the use
Of this my method, so I no abuse
Put on the words, things, readers, or be rude
In handling figure, or similitude,
In application; but, all that I may,
Seek the advance of truth this or that way.
Day 1
Monday 22 August 2022
Jamie greet
Veronica tour
Cla
Slack for Eric & dev 95% on Slack
Mac Welcome!
ID card: 14706 or 36987
Jess project manager
Training Chanel on slack
I’m #17 + 2 more soon
New team, 12 been here less than a year
2 Training spiders: location data, done by thurs
Pyquery / regex
Pycharm
SQL workbench
Docker
Then integrate them
CF1 py2.7
CF2 There is no CF2
CF3 py3
CFx Next Generation, dream phase
Jira tickets is what I look at every day
Tempo tab
Log to training at first VK-10 everyday
Lunch around noon
Team stand up Jason 11:30 (scrum)
Confluence plugin for Jira does docs, calendars vacations
Monthly meetings with Json for 1on1 to talk about stuff
Open to improvements
LinkedIn
locati
We all get PR days for code review
External:
X5 outside pricy
Brightdata
Scrapuer API
Clients
Raven is #1
Day 3
Wednesday 24 August 2022
Framework walk-thru with Eric
Laptop setup
Day 5
Friday 26 August 2022
Eric help with Advance Auto Parts investigation
Improvements: parameratized
Lunch & Learn for Jira
Day 7
Tuesday 30 August 2022
Advance Auto Parts ready
Jess’ documentation meeting with collections
Cf1-locationsystem very active so it is the only system that does not have developers merge the code adhoc but instead code is merged everyday at 4:00 PM
Sept 6
Jason
RCT
Master/child
Update master if I have notes
Cyber Duck for S3 buckets
[|] link
RCT / SD can have S3 links or upload
If not valid then spend only 15 mins to see what the problem is, if can’t find problem then block
Collection tickets are higher priority than RCTs
RCT have 16-18 hours / week / dev
Workflow: if it has ReadyForQA then need to attach report otherwise if it has next status is Valid(Done) then just validate and it will go to QA with no report
@here don't use hn4 for your proxies....if you use hn4 you're gonna have a bad time. use hn1
class DigitalLifeStanceSpider(SpiderBase):
default_proxy_address = 'http://80146:EybWb4@hn1.nohodo.com:6505/'
Sept 13
Mentoring
Helped Vallee again for close to an hour with Git PR - 1hr
Still working on LifeStance
QA & Data overview - 1hr
Sept 9
Late
Office hours 1h Courtney says Jess’s My Tasks dashboard is locked down somehow and that’s why I can’t edit my copies of it
db access still denied: prob bc wrong vpn
time tempo timesheets sill not working, bc 100+ employees
Keeper Stavros13!
40m
Installing cf3 to move Planet Fitness
2h
Vpn just disconnected and can’t reconnect
Can’t install cf3
make migrate
File "/home/retailcf3/.local/lib/python3.8/site-packages/debug_toolbar/apps.py", line 10, in <module>
from django.utils.translation import ugettext_lazy as _
ImportError: cannot import name 'ugettext_lazy' from 'django.utils.translation' (/home/retailcf3/.local/lib/python3.8/site-packages/django/utils/translation/__init__.py)
make: *** [sync_system] Error 1
Time Tempo time sheet still not working, and also not working at least from yesterday
Sept 16
Eric not Happy
and just for transparency, the reason I keep bringing up productivity and efficiency is because we brought you in as a SE III, thats about as high as we get on the team. Most of the team are SE I or SE II, but your experience in the field is greater than theirs. The goal is to get you on some of the harder stuff and so far, we havent really gotten to that level yet. Im confident we will get there, I know learning the framework takes time.
So there’s that
Eric finished LifeStance when I failed to finish the second spider
Ported PlanetFitness from cf1 to cf3
